Structured Abstract 


Opioid stewardship interventions promote the appropriate use of 
prescribed and ordered opioids to reduce the risk of opioid adverse events. Our main 
objectives were to determine the effectiveness of these interventions in healthcare 
settings on opioid prescribing and clinical outcomes (e.g., number of opioid 
prescriptions, opioid dosage, overdose, emergency department visits, and 
hospitalizations) including unintended consequences (e.g., changes in patient-reported 
pain intensity), and ways these interventions can be effectively implemented. 


We followed rapid review processes of the Agency for Healthcare 
Research and Quality Evidence-based Practice Center Program. We searched PubMed 
and the Cochrane Library to identify eligible systematic reviews from January 2019 to 
April 2023 and primary studies published from January 2016 to April 2023, 
supplemented by targeted gray literature searches. We included systematic reviews 
and studies that addressed opioid stewardship interventions implemented in healthcare 
settings in the United States and that reported on opioid prescribing and clinical 
outcomes. 


Our search retrieved 6,431 citations, of which 34 articles were eligible 
(including 1 overview of systematic reviews, 13 additional systematic reviews, 13 
randomized controlled trials (RCTs) [reported in 14 articles] and 6 nonrandomized 
studies). Systematic reviews, mostly summarizing pre-post studies, included a wide 
variety of opioid stewardship practices that focused on patient and family engagement, 
healthcare organization policy, or clinician knowledge and behavior interventions, in 
inpatient, perioperative, emergency department, and ambulatory settings. RCTs 
addressed multicomponent interventions (typically a combination of prescriber 
education, care management and facilitated access to resources), and patient education 
and engagement, mainly in ambulatory chronic pain. Opioid stewardship practices 
involving clinical decision support or electronic health records, or multicomponent 
interventions (including for chronic pain) were associated with decreases in opioid 
prescribing or reduced doses and no increases in pain, emergency department visits, or 
hospitalizations (low strength of evidence for all outcomes). Patient engagement and 


Agency for Healthcare 
Research and Quality 


ERVICES 
3s Y, 
S 8, 
s 4 
* _—7 
gE 
2 = ~ 
% 
a, 
‘Larva! 


education interventions had mixed results for opioid prescribing outcomes (insufficient 
strength of evidence) and no increases in pain, emergency department visits, or 
hospitalizations (low strength of evidence). The evidence was insufficient on other 
types of interventions and on outcomes of opioid refill requests and refills, patient 
satisfaction, or overdose. Barriers included lack of training, workload, gaps in 
communication, and inadequate access to nonpharmacological resources. Facilitators 
included clinician and patient acceptance of intervention components. 


Conclusions. Selected opioid stewardship interventions may be effective for 
reducing opioid prescribing and dosing without adversely affecting clinical outcomes 
overall, although strength of evidence was low. Unintended consequences were often 
not measured or not measured rigorously. Interventions to reduce opioid use should 
monitor unintended consequences and include access to nonpharmacological pain 
management resources with appropriate patient education and engagement. 
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1. Background and Purpose 


The Agency for Healthcare Research and Quality (AHRQ) Making Healthcare 
Safer (MHS) reports consolidate information for healthcare providers, health system 
administrators, researchers, and government agencies about practices that can improve 
patient safety across the healthcare system—from hospitals to primary care practices, 
long-term care facilities, and other healthcare settings. In spring 2023, AHRQ 
launched the fourth iteration of the MHS report (here referred to as MHS IV). Opioid 
stewardship was identified as high priority for inclusion in the MHS IV reports using a 
modified Delphi technique by a Technical Expert Panel (TEP) that met in December 
2022. The TEP included 15 experts in patient safety with representatives of 
governmental agencies, healthcare stakeholders, clinical specialists, experts in patient 
safety issues, and a patient/consumer perspective. See the MHS IV Prioritization 
Report for additional details.' 

The treatment of pain and suffering is fundamental to high-quality healthcare, and 
opioids are often an essential medicine for acute, severe pain. However, opioids also 
carry well known risks, including overdose, misuse and opioid use disorder.”“ In 
2016, the Centers for Disease Control and Prevention (CDC) released a Clinical 
Practice Guideline for Prescribing Opioids for Pain to promote more effective and safe 
opioid prescribing. In 2022, the CDC released an update to those guidelines, noting a 
concern that previous guidance had been misapplied, leading to unintended patient 
harm including untreated or undertreated pain and abrupt discontinuation of opioids 
causing withdrawal, distress, and suicidal ideation. Thus, any patient safety practice 
(PSP) to mitigate risks of prescribed or ordered opioids should be balanced against 
unintended harms.? 


1.1 Overview of the Patient Safety Practice 


Opioid stewardship can be defined as promoting the appropriate use of prescribed 
and ordered opioids while reducing the risk of opioid use disorder, misuse, overdose, 
and other adverse events.* The National Quality Forum (NQF) identified fundamental 
actions to support opioid stewardship in healthcare organizations,° six of which are 
relevant to this report: 

*Promote leadership commitment and culture, 

*Implement organizational policies, 

*Advance clinical knowledge, expertise, and practice, 

*Enhance patient and family caregiver education and engagement, 

¢Track, monitor, and report performance data, and 

¢Establish accountability. 

The updated 2022 CDC Clinical Practice Guideline for Prescribing Opioids for 
Pain provides guidelines for determining whether opioids are appropriate, deciding 
duration, dosage and followup for prescriptions, and assessing risk and addressing 
potential harm.? 
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The MHS III report conducted a targeted search of the literature and summarized 
one systematic review and 14 original studies on this topic, mainly pre-post studies.° 
In that limited review, most studies examined multicomponent interventions consisting 
of clinical interventions and implementation strategies, with a conclusion of moderate 
strength of evidence for only one outcome—significant reduction in opioid dosages. 
MHS III did not draw conclusions about clinical outcomes or impact on pain. 


1.2 Purpose of the Rapid Review 


The overall purpose of this review is to determine the effectiveness of opioid 
stewardship interventions in healthcare facilities or systems on key opioid prescribing 
and clinical outcomes (e.g., opioid dosage, opioid prescriptions, overdose, emergency 
department visits, and hospitalizations) including unintended consequences (e.g., 
changes in pain intensity), and how these interventions can be effectively 
implemented. 


1.3 Review Questions 


1. What are the frequency and severity of harms associated with opioid 
prescribing and ordering (i.e., outpatient prescribing or inpatient ordering)? 

2. What patient safety measures or indicators have been used to examine the 
harms associated with opioids prescribed or ordered by clinicians? 

3. What opioid stewardship PSPs have been used to prevent or mitigate the 
harms associated with prescribed or ordered opioid, and in what settings have 
they been used? 

4. What is the rationale for the opioid stewardship practices that have been used 
to prevent or mitigate the harms associated with prescribed or ordered 
opioids? 

5. What are the effectiveness and unintended effects of opioid stewardship 
practices, and what new evidence has been published since the search was 
done for the MHS III report in 2019? 

6. What are common barriers and facilitators to implementing opioid 
stewardship practices? 

7. What resources (e.g., cost, staff, time) are required for implementation of 
opioid stewardship practices? 

8. What toolkits are available to support implementation of opioid stewardship 
practices? 
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@3 2. Methods 


We followed processes proposed by the Agency for Healthcare Research and 
Quality (AHRQ) Evidence-based Practice Center (EPC) Program.’ The final protocol 
for this rapid review is posted on the AHRQ website at: 
https://www.ahrq.gov/research/findings/making-healthcare-safer/mhs4/index.html. 
The protocol for this rapid review is registered in PROSPERO (registration number 
CRD42023432272). 

For this rapid review, strategic adjustments were made to streamline traditional 
systematic review processes and deliver an evidence product in the allotted time. 
Adjustments included being as specific as possible about the questions, limiting the 
number of databases searched, modifying search strategies to focus on finding the 
most valuable studies (1.e., being flexible on sensitivity to increase the specificity of 
the search), and restricting the search to studies published in English and performed in 
the United States (to be most relevant to healthcare systems in the United States). For 
this report, we used the artificial intelligence (AI) feature of DistillerSR (AI Classifier 
Manager) as a second reviewer at the title and abstract screening stage. 

We asked our content experts to answer Review Questions 1| and 2 by citing 
selected references that best answer the questions without conducting a systematic 
search for all evidence on the targeted harms and related patient safety measures or 
indicators. For Review Question 2, we focused on identifying relevant measures that 
are included in the Centers for Medicare & Medicaid Services (CMS) patient safety 
measures, AHRQ’s Patient Safety Indicators, or the National Committee for Quality 
Assurance (NCQA) patient safety related measures. We asked content experts to 
answer Review Questions 3 and 4 by citing selected references, including patient 
safety practices (PSPs) used and explanations of the rationale presented in the studies 
we found for Review Question 5. For Review Questions 6 and 7, we focused on the 
barriers, facilitators, and required resources reported in the studies we found for 
Review Question 5. For Review Question 8, we identified publicly available patient 
safety toolkits developed by AHRQ or other organizations that could help to support 
implementation of the PSPs. To accomplish that task, we reviewed AHRQ’s Patient 
Safety Network (PSNet) and AHRQ’s listing of patient safety related toolkits and we 
included any toolkits mentioned in the studies we found for Review Question 5.°° We 
identified toolkits without assessing or endorsing them. 


2.1 Eligibility Criteria for Studies of Effectiveness 


We searched for original studies and systematic reviews on Review Question 5 
(the question addressing effectiveness studies) according to the inclusion and 
exclusion criteria presented in Table 1. 
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Table 1. Inclusion and exclusion criteria 


Study Parameter Inclusion Criteria Exclusion Criteria 
Population Any clinical population (i.e., people receiving care None 
from a healthcare professional) 
Because opioids can result in significant harms in 
any clinical population, we will include populations 
not included in the CDC guidelines, such as sickle 
cell disease, cancer-related pain treatment, 
palliative care, and end-of-life care 
Intervention e Interventions focused on opioid stewardship e Interventions focused on 
involving organizational leadership and policies treatment of opioid use disorder 
within a healthcare facility or healthcare system: (we note that this is often 
o Opioid stewardship committees included in opioid stewardship 
o Clinical decision support or electronic interventions, but this was a 
health record interventions separate topic in MHS III)° 
o Protocols or care bundles, which may * Interventions or policies 
address components such as treatment established by entities other 
agreements, urine drug screening, risk than healthcare providers, 
assessment, and/or naloxone prescribing including: 
: a o Insurance company 
e Interventions focused on clinical knowledge, restrictions (e.g., limits on pill 
expertise, and behavior related to prescribed or numbers or prior 
ordered pe ids: : : 7 authorization) 
o Clinician education or academic detailing —_ 
ae ; ; o Government restrictions or 
o Clinical pharmacist consultation regulations (e.g., 
o Increased access/emphasis on nonopioid establishment of prescription 
opioid prescribing/ ondenng : o Naloxone distribution outside 
o Healthcare organization guidelines healthcare settings (e.g., by 
e Interventions focused on patient and family county health departments) 
education or engagement related to use of 
prescribed or ordered opioids 
e Interventions focused on tracking, monitoring, 
and reporting performance data related to 
prescribed or ordered opioids: 
o Clinical audits 
o Dashboards 
e Interventions focused on clinical accountability 
related to prescribed or ordered opioids: 
o Prescriber feedback 
o Peer comparison 
e Multicomponent interventions focused on opioid 
stewardship 
Comparator Usual care No comparison group 
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Study Parameter 


Inclusion Criteria 


Exclusion Criteria 


Outcome Primary outcomes of interest are clinical outcomes. | Studies with prescribing/ordering 
Secondary outcomes of interest are outcomes or process outcomes or 
prescribing/ordering outcomes and process implementation outcomes without 
outcomes, if they are reported in studies that also clinical outcomes 
report clinical outcomes. 

e Clinical outcomes: 
o Healthcare utilization (focusing on 
emergency department use and 
hospitalizations for adverse events) 
o Overdose rates (which may be relevant to 
inpatient opioid ordering, number of pills 
or doses prescribed at discharge, and 
long-term, chronic opioid use) 
o Adverse consequences: 
« Patient-reported outcomes — changes in 
pain intensity or distress 
" Rates of opioid refill requests 
" Patient satisfaction 
e Opioid prescribing or ordering outcomes: 
o Rates of opioid prescribing or ordering 
o Total morphine milligram equivalents per 
prescription or per patient 
o Number of pills per prescription 
o Rates of nonopioid analgesic prescribing 
e Changes in process outcomes: 
o Urine drug screen ordering or 
administration 
o Treatment agreement use 
o Risk assessment screening tool use 
o Use of prescription drug monitoring 
program reports 
o Other referrals relevant to pain 
management (behavioral health, physical 
therapy, etc.) 
o Pain management documentation 
e Implementation outcomes (Review Questions 
6 and 7) 
o Barriers and facilitators 
o Cost, staffing, time 
Timing e Systematic reviews published since 2019 e Systematic reviews published 
Original studies published since 2016, the year before 2019 
the initial CDC guideline on opioid prescribing e Original studies published 
was published, which may have led to shifts in before 2016 
prescribing 
Setting Healthcare settings in the United States e Outside of healthcare (e.g., 


State-level regulation) 
e Nursing home or prison settings 
No site in the United States 
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Study Parameter 


Inclusion Criteria 


Exclusion Criteria 


Type of studies 


Systematic reviews 

Randomized controlled trials, nonrandomized 
controlled trials, and observational studies with 
a comparison group 

Studies should include at least 50 pills, 
prescriptions, or patients or at least 50 
clinicians, to ensure a minimum number to limit 
studies with too small of a sample size to 
provide meaningful results 


e Narrative reviews, scoping 
reviews, editorials, 
commentaries, and abstracts 

e Qualitative studies without 
quantitative data 


CDC = Centers for Disease Control and Prevention; MHS = Making Healthcare Safer; PSP = patient safety practice 
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2.2 Literature Searches for Studies of Effectiveness 


We searched PubMed and the Cochrane Library, supplemented by a narrowly 
focused search for unpublished reports that are publicly available from governmental 
agencies, professional societies, or membership organizations with a strong interest in 
the topic, including the Centers for Disease Control and Prevention (CDC), AHRQ, 
the National Institutes of Health (NIH), National Quality Forum (NQF), and American 
Hospital Association (AHA). Given that MHS III used such a limited search, rather 
than using the end of that report as the start date for our search, we searched for 
original studies since the release of the CDC guidelines in 2016 that contributed to 
changes in practice and opioid stewardship interventions, and we searched through 
April 2023. For details of the search strategy, see Appendix A. 


2.3. Data Extraction (Selecting and Coding) 


We used the AI feature of DistillerSR (AI Classifier Manager) as a semi- 
automated screening tool to conduct this review efficiently at the title and abstract 
screening stage. The title and abstract of each citation were screened by a team 
member based on predefined eligibility criteria (Table 1). The screening responses by 
the team members were used to teach the AI Classifier Manager, which served as a 
second reviewer of each citation. Discrepancies between team members and the AI 
Classifier Manager were reviewed and resolved by the team members. The full text of 
each remaining potentially eligible article was reviewed by a single team member to 
confirm eligibility. A second team member checked a 10 percent sample of the full 
text reviews to verify that important studies were not excluded. 

We prioritized our efforts by extracting detailed information from the highest 
quality studies. Given the large number of systematic reviews and studies with strong 
designs, we focused on extracting detailed information from systematic reviews, 
randomized controlled trials (RCTs), nonrandomized controlled trials (NRCTs), and 
observational studies with a comparison group. We listed relevant studies having weak 
pre-post designs with limited information in Appendix C, but we did not synthesize 
them in the text of the results section. 

Reviewers extracted available information and organized it according to the review 
questions and included author, year, study design, frequency and severity of the harms, 
measures of harm, characteristics of the PSP, rationale for the PSP, outcomes, 
implementation barriers and facilitators, resources needed for implementation, and 
description of toolkits. One reviewer completed the data abstraction, and a second 
reviewer checked the first reviewer’s abstraction for completeness and accuracy. 


2.4 Risk of Bias (Quality) Assessment 


For studies that addressed Review Question 5 about the effectiveness of PSPs, we 
used the Cochrane Collaboration’s tool for assessing the risk of bias of RCTs or the 
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ROBINS-I tool for assessing the Risk Of Bias In Non-randomized Studies — of 
Interventions.!°!! We did not assess the risk of bias in the pre-post studies, recognizing 
that they have a high risk of bias because of the lack of a separate comparison group. 

For RCTs, we used the items in the Cochrane Collaboration’s tool that cover the 
domains of selection bias, performance bias, detection bias, attrition bias, reporting 
bias, and other bias.'° For nonrandomized studies, we used specific items in the 
ROBINS-I tool that assess bias due to confounding, bias in selection of participants 
into the study, bias in classification of interventions, bias due to deviations from 
intended interventions, bias due to missing data, bias in measurement of outcomes, and 
bias in selection of the reported results. The risk of bias assessments focused on the 
main outcome of interest in each study.!! 

For a recent eligible systematic review, the primary reviewer used the criteria 
developed by the United States Preventive Services Task Force Methods Workgroup 
for assessing the quality of systematic reviews.!” 

e Good - Recent relevant review with comprehensive sources and search 
strategies; explicit and relevant selection criteria; standard appraisal of 
included studies; and valid conclusions. 

e Fair - Recent relevant review that is not clearly biased but lacks 
comprehensive sources and search strategies. 

e Poor - Outdated, irrelevant, or biased review without systematic search for 
studies, explicit selection criteria, or standard appraisal of studies. 


2.5 Strategy for Data Synthesis 


We natratively summarized findings across systematic reviews and across primary 
studies. We did not conduct a meta-analysis. For Review Question 5 about the 
effectiveness of PSPs, we recorded information about the context of each primary 
study and whether the effectiveness of the PSP differed across patient subgroups. As 
the systematic reviews generally summarized the literature descriptively and did not 
grade the strength of evidence, we based our grading on the primary studies. We 
graded the strength of evidence for PSPs with more than one primary study of 
effectiveness using the methods outlined in the AHRQ Effective Health Care Program 
Methods Guide for Effectiveness and Comparative Effectiveness Reviews and 
focusing on the key clinical outcome for each intervention type such as adverse 
consequences of changes in pain intensity or healthcare utilization, and the key opioid 
prescribing outcome such as quantity or doses.'* 
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aM 3. Evidence Summary 


3.1 Benefits and Harms 


e PSPs involving clinical decision support or electronic health record 
interventions, and multicomponent PSPs (including for chronic pain) were 
associated with decreases in opioid prescribing or doses (low strength of 
evidence). 

e PSPs involving patient engagement and education had mixed results for 
opioid prescribing outcomes (insufficient strength of evidence). 

e PSPs involving clinical decision support or electronic health record 
interventions, patient engagement and education, and multicomponent PSPs 
did not show an increase in pain, emergency department visits, or 
hospitalizations (low strength of evidence for all outcomes). 

e The evidence was insufficient on the following intervention types: opioid 
stewardship committees, protocols or care bundles, clinician education or 
academic detailing, clinical pharmacist consultation, increased 
access/emphasis on nonopioid or multimodal analgesia, and/or limits on 
opioid prescribing/ordering, healthcare organization guidelines, clinical 
audits, dashboards, prescriber feedback, and peer comparison 

e The evidence was insufficient on outcomes of opioid refill requests and refills, 
patient satisfaction, or overdose. 

e Barriers included lack of clinician training, workload, gaps in communication, 
and inadequate access to non-pharmacological resources. Clinician and patient 
acceptance of intervention components were facilitators. 


3.2 Future Research Needs 


e More research is needed on opioid stewardship committees, dashboards and 
peer comparisons, and care bundle interventions such as urine drug testing, 
drug use contracts, and prescription drug monitoring program queries, which 
are commonly used health system interventions and quality indicators. 
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4. Evidence Base 
4.1 Number of Studies 


Our search retrieved 6431 unique titles and abstracts from which we reviewed 
6431 full text articles for eligibility (Figure 1). We found 34 studies that met our 
eligibility criteria. A listing of studies excluded during full text review is included in 
Appendix B, List of Included Studies, and information abstracted from each included 
study is provided in Appendix C, Evidence Tables. 

Pre-post studies do not have a separate comparison group and thus have a high risk 
of bias, we did not discuss them in the main body of the report, but we summarize 
them briefly in the appendix. 


Figure 1. Results of the search and screening 


Citations identified through electronic database 
searching after duplicates removed 
(n=6,43 1) 


Records excluded 
(n=5,839) 


Records screened 
(nre431) Excluded at full-text review (n=473) 

Systematic review published before 2019 = 7 

An original study published before 2016 = 1 

Non-USA-based study or does not report data separately 

for USA (this applies to only individual primary study) = 

18 

Not focused on an intervention of interest = 63 

Retrieved for full-text review No comparison group = 22 
(n=592) Qualitative study without any quantitative data = 21 
Includes only nursing home or prison settings = 1 
Intervention or policies established by entities other than 
healthcare providers = 38 
Interventions focused on naloxone distribution = 2 
Interventions focusing on treatment of opioid use disorder 
=6 
Addresses effectiveness review question/implementation 
but does not report clinical outcomes = 203 
No outcome of interest = 14 
Does not meet sample size criteria = 5 
No original data = 26 
Included (n=34) Narrative or scoping review/conference abstracts = 8 

Other (Enhanced Recovery After Surgery pathway, Making 

Systematic reviews = 14 Healthcare Safer II] manuscript, included in previous 
reviews, guidelines) = 38 


Primary studies = 19 studies 
reported in 20 articles 


Pre-post studies included only in appendix = 85 
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4.2 Findings for Review Questions 


Figure 2 presents an overview of included evidence by type of opioid stewardship 
intervention. We did not find any recent systematic reviews or original studies that 
specifically examined the effectiveness of opioid stewardship committees, dashboards, 
or prescriber feedback. 

Characteristics of the included systematic reviews and primary studies are 
presented in Tables 2a and 2b. 


Figure 2. Overview of included evidence by type of opioid stewardship intervention*t 


Number of SRs and recent primary studies 
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SR = systematic review 
* The numbers of pre-post studies are not included in this figure. 
tPrimary studies and systematic review references are available in Table 3. 
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Table 2a. Characteristics of the included systematic reviews 


a 


Clinical audit( [> 
Peer comparison eS) 


engagement intervention 


Patient and family education, or 


O 


Multicomponent interventions 


opioid treatment in 
people with chronic 
noncancer pain. 


Included studies, 36 


RCTs = 27 
NRCTs =5 
Observational = 0 
Other = 4 


knowledge, 
expertise, and 
behavior 

e Patient and family 
education or 
engagement 


e Rates of opioid 
prescribing or ordering 

e Total MME per 
prescription or per 
patient 


Author, Objective Search Date Opioid Outcomes of Interest Quality 

Year Stewardship of the 
Included Studies, n | Interventions Review* 
Study Designs, n 

Avery, Review interventions | Search date: July e Interventions e Pain intensity or Good 

2022'4 to reduce long-term | 2021 addressing clinical distress 


Making Healthcare Safer IV — Opioid Stewardship 


opioid overdose. 


251 


RCTs = 32 
NRCTs =5 
Observational = 155 
Other = 59 


e Organizational 
leadership and 
policies 

e Patient and family 
education or 
engagement 

e Tracking, 
monitoring, and 
reporting 
performance data 

e Multicomponent 
interventions 
(system policies 
such as opioid 
dosing limits plus 


e Overdose rates 

e Rates of opioid 
prescribing or ordering 

e Total MME per 
prescription or per 
patient 


Author, Objective Search Date Opioid Outcomes of Interest Quality 
Year Stewardship of the 
Included Studies, n | Interventions Review* 
Study Designs, n 
Carnes, Review of the Search date: e Studies e Healthcare utilization Fair 
20225 effectiveness of January 2000 to individually e Opioid refill requests 
various types of January 2021 addressing e Pain intensity or 
interventions in different types of distress 
reducing opioid Included studies, 22 interventions were | e Patient satisfaction 
prescriptions after combined in the e Rates of opioid 
urological surgery. RCTs =0 synthesis prescribing or ordering 
NRCTs = 0 
Observational = 22 
Other = 0 
Haegerich, | Synthesizes Search date: e Interventions e Healthcare utilization Good 
2019'¢ effectiveness of January 2013 to addressing clinical | e Pain intensity or 
prevention strategies | May 2018 knowledge, distress 
that address expertise, and e Number of pills per 
prescription and illicit | Included studies, behavior prescription 


a a 1) 


outpatient clinical 
settings, community 
pharmacies and 
primary care 


Included studies, 14 


RCTs = 1 
NRCTs = 2 


analgesic prescribing 

e Total MME per 
prescription or per 
patient 


Hopkins, Identify the objective | Search date: e Interventions e Opioid refill requests Fair 
2019!” impacts of education | December 2018 addressing clinical | e Pain intensity or 
interventions on knowledge, distress 
opioid prescribing in | Included studies, 9 expertise, and e Number of pills per 
the acute care behavior prescription 
setting. RCTs =0 e Rates of nonopioid 
NRCTs = 0 analgesic prescribing 
Observational = 9 e Rates of opioid 
Other = 0 prescribing or ordering 
e Total MME per 
prescription or per 
patient 
Iqbal, Assess the Search date: e Interventions e Pain intensity or Fair 
2022!8 effectiveness of January 1990 to addressing clinical distress 
interventions June 2020 knowledge, e Other referrals relevant 
delivered by expertise, and to pain management 
pharmacists in behavior e Rates of nonopioid 
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Author, Objective Search Date Opioid Outcomes of Interest Quality 
Year Stewardship of the 
Included Studies, n | Interventions Review* 
Study Designs, n 
services in Observational = 8 
optimizing opioid Other = 3 
therapy for people 
with chronic 
nonmalignant pain. 
Explore 
stakeholders’ 
opinions about role 
of pharmacists in 
optimizing opioid 
therapy. 
Kadakia, Evaluate the impact | Search date: 1996 to | e Patient and family | e Pain intensity or Poor? 
2020!° of prescription October 2018 education or distress 
opioid-related engagement e Overdose rates 
education provided : e Total MME per 
to a patient by a Hier pie wi prescription or per 
healthcare provider y g patient 
on patient outcomes. nipeteponed| 
Langford, Synthesize and Search date: August | e Multicomponent e Rates of opioid NAS 
20237° evaluate evidence 2011 to August 2021 interventions? prescribing or ordering 
from systematic e Pain intensity or 
feck ee g Included studies, 12 Gieitees 
and outcomes of 
patient-targeted RCTs =0 
opioid deprescribing | NRCTs =0 
interventions for all Observational = 0 
types of pain. Other = 12 
Liu, 20202! Summarize the Search date: 1960 to | e Interventions e Healthcare utilization Fair 
effectiveness of March 2018 addressing clinical | ¢ Pain intensity or 
interventions on knowledge, distress 
appropriate opioid ‘ expertise, and e Patient satisfaction 
use for noncancer ender eet behavior e Rates of nonopioid 
pain among hospital e Organizational analgesic prescribing 
inpatients. RCTs =4 leadership and ° Rates of opioid 
NRCTs = 0 policies prescribing or ordering 
Observational = 31 e Tracking, 
Other = 2 monitoring, and 
reporting 
Po performance ata. ff 
Lovecchio, | Evaluate institutional | Search date: e Interventions e Opioid refill requests Fair 
2019” strategies that October 2018 addressing clinical | e Pain intensity or 
reduce opioid knowledge, distress 
administration or : expertise, and e Patient satisfaction 
consumption after Included studies, 13 behavior e Rates of nonopioid 
orthopedic surgery. e Organizational analgesic prescribing 
RCTs =1 leadership and e Rates of opioid 
NRCTs = 0 policies prescribing or ordering 
Observational = 11 e Patient and family | e Total MME per 
Other = 1 education or prescription or per 
engagement patient 
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designed to reduce 
the rate of opioid 
prescriptions or the 
quantity prescribed 
for pain in adults 
discharged from the 
emergency 
department. 


Included studies, 63 


RCTs = 1 

NRCTs =0 
Observational = 39 
Other = 23 


accountability 

e Clinical 
knowledge, 
expertise, and 
behavior 

e Organizational 
leadership and 
policies 

e Tracking, 
monitoring, and 
reporting 


prescribing or ordering 


Total MME per 
prescription or per 
patient 


Author, Objective Search Date Opioid Outcomes of Interest Quality 
Year Stewardship of the 
Included Studies, n | Interventions Review* 
Study Designs, n 
Phinn, Summarize the Search date: 2011 to | e Interventions e Healthcare utilization Fair 
2023” effectiveness of March 2021 addressing clinical | e Pain intensity or 
organizational knowledge, distress 
interventions on : expertise, and e Patient satisfaction 
appropriate opioid Included studies, 43 Sonavior e Rates of nonopioid 
prescribing for e Multicomponent analgesic prescribing 
noncancer pain RCTs =3 interventions? e Rates of opioid 
upon hospital NRCTs = 0 e Organizational prescribing or ordering 
discharge. Observational = 38 leadership and 
Other = 2 policies 
Raoul, Review and analyze | Search date: May e Interventions e Patient satisfaction Poor? 
202274 interventions 15, 2020 addressing clinical | e Rates of opioid 


performance data 


postoperative opioid 
consumption 


Included studies, 11 


Wong, Synthesize the Search date: June e This synthesis e Healthcare utilization Fair 
20207 available evidence 2018 combined studies | e Total MME per 
on interventional of different types prescription or per 
strategies to improve ; of interventions atient 
care-associated nelndemstidies 12 (e.g., care policies, : 
outcomes for care plans, care 
patients with chronic | RCTs =4 coordination) 
noncancer pain who | NRCTs =0 
frequently use the Observational = 9 
emergency Other = NR 
department. 
Zhang, Summarize Search date: e Interventions e Healthcare utilization Fair 
20207° strategies to reduce | December 2018 addressing clinical | e Opioid refill requests 
postsurgical opioid knowledge, e Pain intensity or 
prescribing at : expertise, and distress 
discharge. Included studies, 24 behavior e Number of pills per 
e Organizational prescription 
RCTs = 1 leadership and e Patient satisfaction 
NRCTs =0 policies e Rates of opioid 
Observational = 22 e Patient and family prescribing or ordering 
Other = 1 education or e Total MME per 
engagement prescription or per 
patient 
Zorrilla- Evaluate the impact | Search date: e Patient and family | Opioid refill requests Good 
Vaca, of perioperative September 2020 education or 
202277 opioid education on engagement 
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Author, Objective Search Date Opioid Outcomes of Interest Quality 
Year Stewardship of the 
Included Studies, n | Interventions Review* 


Study Designs, n 


patterns including 
opioid cessation, 


number of pills ean k : 
consumed, and Observational =0 
opioid prescription Other = NR 


refills. 


MME = morphine milligram equivalents; n = sample size; NA = not applicable; NR = not reported; NRCT = nonrandomized 
controlled trial; RCT = randomized controlled trial 

*We used the criteria developed by the United States Preventive Services Task Force Methods Workgroup for assessing the 
quality of systematic reviews. 

‘Please see Appendix C, Evidence Table C-7 for the additional details on the multicomponent intervention. 

'Systematic reviews were given a poor rating due to lack of standard study assessment such as risk of bias or strength of evidence 
grading or high possibility of bias in statistical methods. 

SLangford, et al.2° is a review of systematic reviews and not applicable to be assessed using the United States Preventive Services 
Task Force Methods Workgroup tool for assessing quality of systematic reviews. 


Table 2b. Characteristics of the included primary studies (pre-post studies listed in Appendix*) 


Opioid Author, Year Study Setting Description of Intervention | Outcomes of Interest 
Stewardship 
Intervention Study Design Number of 
Category Participants, N 
Organizational Ahmed, 201678 Emergency ED headache treatment e Healthcare utilization 
leadership and Department algorithm with stepwise e Rates of opioid 
policies Nonrandomized instructions for diagnosis, prescribing or ordering 
interventional N=144 patients treatment, and discharge e Pain intensity or 
study planning distress 
Bachhuber, Primary care and Site level change to the EHR e Healthcare utilization 
202129 ED to implement a uniform, e Rates of opioid 
reduced, default dispense prescribing or ordering 
Cluster N=21,331 patients | quantity of 10 tablets for new ¢ Opioid refill requests 
randomized opioid analgesics e Number of pills per 
control trial prescriptions prescription 


e Total MME per 
prescription or per 


patient 
Bachhuber., Ambulatory care Site-level change to the EHR | e Healthcare utilization 
2022°0 to implement a uniform, e Rates of opioid 
reduced, default dispense prescribing or ordering 
Cluster N=6,309 patients | quantity of 10 tablets or 5 e Opioid refill requests 
randomized tablets for new opioid e Number of pills per 
control trial analgesic prescriptions. prescription 
e Total MME per 
prescription or per 
patient 
Clinical Sada, 2019?! Ambulatory care A guideline was developed to | e Opioid refill requests 
knowledge, standardize post-discharge e Patient dissatisfaction 
expertise, and Quality prescribing, and the e Number of pills per 
behavior related improvement N= 88 patients improvement process was prescription 
to prescribed or repeated iteratively. ¢ Total MME per 
ordered opioids prescription or per 
patient 
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family education 
or engagement 
intervention 


RCT 


Egan, 2020 


RCT 


Voepel-Lewis, 
20214 


RCT 


N=140 patients 


Ambulatory care 


N=100 patients 


Inpatient 


N= 604 parent- 
child dyads 


recommended postoperative 
opioid usage, side effects, 
dependence, and addiction 
via a 2-minute narrated video 
and a handout detailing the 
risks of “narcotic” overuse 
and abuse. 

Brief patient-based 
educational intervention using 
an educational instrument 
containing information about 
pain expectations and goals, 
examples of opioid and 
adjunct medications that may 
be used perioperatively, risks 
associated with opioid use 
and examples of non- 
medication pain control 
methods and statements to 
normalize the pain 


Routine instruction plus the 
Scenario-Tailored Opioid 
Messaging Program 
educational intervention, 
designed to provide scenario- 
specific opioid risk and 
benefit information meant to 
promote better decisions 
toward pain and ADE 
reduction. 


Opioid Author, Year Study Setting Description of Intervention | Outcomes of Interest 
Stewardship 

Intervention Study Design Number of 

Category Participants, N 

Patient and Syed, 2018 Ambulatory care Formal education detailing e Pain intensity or 


distress 


Rates of opioid 
prescribing or ordering 
Opioid refill requests 
Pain intensity or 
distress 

Total MME per 
prescription or per 
patient 


experience for the patient. 


Healthcare utilization 
Rates of opioid 
prescribing or ordering 
Pain intensity or 
distress 


Stepan, 2021* 


RCT 


Ambulatory care 


N= 267 patients 


Standard presurgical 
counseling and standardized 
perioperative pain 
management education 
consisting of a 7-minute 
educational video along with 
a laminated card 
summarizing preoperative 
pain education distributed as 
part of postoperative 
instructions. 


Opioid refill requests 
Pain intensity or 
distress 

Number of pills per 
prescription 

Patient satisfaction 


Delara, 2022°¢ 


RCT 


Ambulatory care 


N=73 women 


A shared decision-making 
framework using a written 
script to guide the research 
staff to initiate conversation 
with the patient, describing 
the reason for opioid 
prescribing, common side 
effects and risks of taking 
opioids, and recommended 
management of pain. Using 
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Healthcare utilization 
Opioid refill requests 
Number of pills per 
prescription 

Patient satisfaction 


this framework, patients 


Opioid Author, Year Study Setting Description of Intervention | Outcomes of Interest 
Stewardship 
Intervention Study Design Number of 
Category Participants, N 
provided insight into the 
number of opioid tablets that 
they felt were appropriate for 
their post-operative 
management, which was then 
prescribed by the research 
team (up to 30 tablets) 
Long, 2022?” Ambulatory care No preoperative prescription e Rates of opioid 
for opioids, but patients had prescribing or 
Prospective, N=83 patients the option to request an ordering 
randomized, oxycodone prescription of ten | e Pain intensity or 
open-label, 5-mg tablets postoperatively distress 
noninferiority e Patient satisfaction 
clinical trial ¢ Opioid refill requests 
Clinical Minegeshi, 20228 | Ambulatory care Policy notice including an e Overdose rates 
accountability extra paragraph stating that 
related to RCT N=140 facilities which do not meet 


prescribed or 
ordered opioids 


Veterans’ Health 
Administration 
facilities (medical 
centers) 


the target of 97% case review 
for high-risk patients (as 
identified by the Stratification 
Tool for Opioid Risk 
Mitigation [STORM] 
dashboard) will receive 
technical assistance and be 
required to submit an action 
plan to improve the case 
review rate 


Multicomponent 
interventions 


Neven, 20169 


RCT 


ED 


N=165 patients 


Information-exchange- 
assisted citywide ED care 
coordination program 
consisting of 

(1) ED case manager to 
assist with barriers to care 
coordination, and 

(2) creation of patient-specific 
ED care guidelines via a 
multidisciplinary committee 
and documented in the ED 
information exchange system 
that faxed the guideline to the 
treating provider when 
patients presented to the 
participating ED 


e Healthcare utilization 
e Rates of opioid 
prescribing or ordering 


Liebschutz, 
2017% 


Cluster 
randomized 
control trial 


Ambulatory care 


N=53 primary care 
clinicians 


Transforming Opioid 
Prescribing in Primary Care 
intervention (nurse care 
management, electronic 
registry, academic detailing, 
and electronic decision tools) 


e Opioid refill requests 

e Rates of opioid 
prescribing or ordering 

e Total MME per 
prescription or per 
patient 

e Treatment agreement 
use 
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Opioid 
Stewardship 
Intervention 
Category 


Author, Year 


Study Design 


Study Setting 


Number of 
Participants, N 


Description of Intervention 


Outcomes of Interest 


e Urine drug screen 
ordering or 
administration 


Samet, 2021; 
Colasanti, 20224! 
42 


Cluster 
randomized 
control trial 


Ambulatory care 


N=411 clinicians; 
114 patients 


Targeting Effective Analgesia 
in Clinics for HIV intervention 
consisting of 3 components: 
(1) a nurse care manager 
with an IT-enabled electronic 
registry to manage patients; 
(2) opioid education and 
academic detailing; and 

(3) facilitated access to 
addiction specialists. 


e Opioid refill requests 

e Pain intensity or 
distress 

e Urine drug screen 
ordering or 
administration 

e Treatment agreement 
use 

e Risk assessment 
screening tool use 

e Patient satisfaction 


Kasman, 202143 


Prospective 
cohort 


Vitzthum, 2022" 


Observational 
study with a 
comparison group 


Morasco, 2022*° 


Cluster 
randomized 
control Trial 


Inpatient 


N=54 patients 


Ambulatory care 


N=42,064 opioid- 
naive patients 


Ambulatory care 


N=35 primary care 
clinicians; 
286 patients 


The opioid-free protocol at 
discharge involved 
interventions at 5 distinct 
steps: 

(1) preoperative clinic visit, 
(2) preoperative surgical 
staging area, 

(3) intraoperative, 

(4) postanesthetic care unit, 
and 

5) discharge 

Opioid Sparing Initiative: A 
program dashboard 
aggregated patient-, clinician- 
, and facility-level data on 
opioid prescribing, including 
high-risk prescriptions such 
as high daily opioid doses 
(defined as 100 MME) and 
concomitant benzodiazepine 
prescriptions. 


To guide safer prescribing, 
providers were alerted to 
prescribing patterns identified 
as high risk or deviated from 
the institutional standard of 
care. 

Improving the Safety of 
Opioid Therapy intervention 
consisting of 

(1) one 2-hour educational 
session for clinicians on 
patient-centered care 
surrounding prescription 
opioid adherence monitoring, 
(2) a nurse care manager 
who met with patients to 


e Healthcare utilization 

e Rates of opioid 
prescribing or ordering 

e Pain intensity or 
distress 

e Total MME per 
prescription or per 
patient 


e Healthcare utilization 

e Rates of opioid 
prescribing or 
ordering 


e Pain intensity or 
distress 

e Total MME per 
prescription or per 
patient 
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Opioid 
Stewardship 
Intervention 
Category 


Author, Year 


Study Design 


Study Setting 


Number of 
Participants, N 


Description of Intervention 


Outcomes of Interest 


Lamm, 2022*6 


Prospective 
cohort 


Inpatient 


N=129 patients 


provide education and 
rationale for screenings. The 
nurse care manager also 
provided tailored 
recommendations to the PCP 
about strategies for improving 
opioid safety and (3) access 
for the nurse case manager 
to an internal medicine 
physician with expertise in 
chronic pain treatment in 
primary care and psychologist 
with expertise in treating 
comorbid pain and substance 
use disorder for additional 
recommendations as needed. 
Opioid reduction intervention 
protocol included: 

(a) an educational component 
provided at the outpatient visit 
with the surgeon with 
instructions tailored to the 
specific procedure, as well as 
the American College of 
Surgeons Safe and Effective 
Pain Control After Surgery 
patient tool; 

(b) preoperative multimodal 
analgesia provided 1 hour 
prior to operation; 

(c) goal-directed fluid 
management, limited 
intraoperative opioid 
administration at the 
discretion of the 
anesthesiologist, and local 
anesthetic administered at 
incision sites; 

(d) postoperative elements of 
the protocol included limited 
post-anesthesia care unit 
administration of opioids 
based on pain scores (opioids 
only allowed for pain visual 
analog score > 6), discharge 
counseling regarding limited 
opioid use at home, and 
instructions to alternate 
between acetaminophen and 
ibuprofen every 3 hours at 
home for pain. 


e Healthcare utilization 

e Pain intensity or 
distress 

e Patient satisfaction 

e Total MME per 
prescription or per 
patient 
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Opioid 
Stewardship 
Intervention 
Category 


Author, Year 


Study Design 


Study Setting 


Number of 
Participants, N 


Description of Intervention 


Outcomes of Interest 


Martinson, 202347 


Observational 
study with a 
comparison group 


Ambulatory care 


N=734 veterans 


Primary Care Pain Education 
and Opioid Monitoring 
Program is made up of an 
interdisciplinary care 
management consult team 
that implements the Veteran 
Affairs/Department of 
Defense recommended 
guidelines for long-term 
opioid therapy among 
patients with chronic pain 
being managed in primary 
care. 


e Healthcare utilization 

e Total MME per 
prescription or per 
patient 

e Urine drug screen 
ordering or 
administration 

e Use of prescription 
drug monitoring 
program reports 

e Other referrals relevant 
to pain management 


ADE = adverse drug effects; ED = emergency department; EHR = electronic health record; HIV = Human Immunodeficiency 
Virus; IT = information technology; mg = milligram; MME = morphine milligram equivalents; PCP =primary care provider; 

RCT = randomized controlled trial; 
*Please see Appendix C, Evidence Table C-50 for additional details on pre-post studies 


4.2.1 Question 1. What Are the Frequency and Severity of 
Harms Associated With Opioid Prescribing and Ordering? 


There are several categories of potential harm associated with opioids. First are 
those generally considered as common adverse effects related to opioid use. A 
systematic review supported by the Agency for Healthcare Research and Quality 
(AHRQ) found that opioids were associated with an increased risk of nausea, 
vomiting, constipation, somnolence, dizziness, and pruritis compared to placebo at 
short term followup, and opioids were also associated with an increased risk of 
discontinuation because of adverse events compared to placebo. The strength of 
evidence (SOE) was considered high for all these outcomes. The systematic review 
did not identify an interaction with higher opioid doses and risk of short-term harm, 
although data was limited (low SOE). Opioids were also associated with an 
increased risk of discontinuation due to adverse events including somnolence, 
nausea, constipation, vomiting and headache compared to a nonopioid at short-term 
followup. Higher opioid dose and long-term opioid use were also associated with 


endocrinologic adverse effects (e.g., testosterone deficiency) (low SOE 


ie 


Other significant opioid risks include more serious adverse events such as 
overdose, mortality, and development of opioid use disorder. From 1999 to 2010 in 
the United States, both opioid prescribing ac and overdose deaths involving 
prescription opioids increased fourfold. Despite declines in opioid prescribing, 
prescription opioids remain the most commonly misused prescription drug in the 


United States.’ 


In the systematic review referenced above, opioid use was associated with an 
increased risk of opioid abuse, overdose, dependence or addiction (low SOE). 
Higher doses of long-term opioid use were also associated with increased risk for 


overdose, overdose mortality, opioid misuse, dependence or addiction (low SOE 
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1a 


Overdose risk was also associated with concomitant use of other medications, 
including benzodiazepines and gabapentinoids (low SOE). One cohort study found 
that long-acting opioids were associated with increased risk of all-cause mortality. 
Another study found higher doses of opioids were associated with a higher risk of 
all-cause mortality, although longer duration of use was associated with a lower 
risk.*8 

Some data also suggests an association between opioid use and risk of falls, risk 
of major trauma or road trauma injury, and risk of myocardial infarction although 
this data is limited (low SOE). There was no association between long-term opioid 
use and risk of suicide or self-harm (low SOE).*® 


4.2.2 Question 2. What Patient Safety Measures or 
Indicators Have Been Used To Examine the Harms 

Associated With Opioids Prescribed or Ordered by 
Clinicians? 


Several quality indicators from United States organizations address harms 
associated with prescribed or ordered opioids. The National Commission on Quality 
Assurance (NCQA) has three relevant ambulatory care indicators: one on risk of 
continued opioid use, defined as a high quantity of prescribed opioids for new 
prescriptions”; one for use of opioids at high dosage’; and one for use of opioids 
from multiple providers.°' The Centers for Medicare & Medicaid Services (CMS) 
has one relevant indicator, for the proportion of hospital encounters where patients 
received an opioid and suffered an adverse event requiring the administration of 
naloxone.” 

The National Quality Forum (NQF) conducted a recent environmental scan 
funded by the United States Department of Health and Human Services reviewing 
additional opioid safety quality indicators from the published and gray literature.° 
The Centers for Disease Control and Prevention (CDC) also sponsored 
development of a set of indicators based on the 2016 opioid guidelines.°? The 
domain of appropriate opioid analgesic prescribing for patients on chronic opioids 
include the following indicators: 

e Documentation of pathology for chronic pain prescribing 
Clinic visits every three months 
Assessment of high-risk or high-dose prescribing 
Annual drug testing 
Opioid agreements 
Documentation of violations and actions taken for closer monitoring 
Consideration of nonpharmacologic interventions 
e Naloxone prescribing 

For new opioid prescriptions, indicators addressed use of nonopioid 

medications, risk assessment, appropriate prescribing consistent with the CDC 
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opioid guidelines, including small amounts for initial prescriptions, avoiding initial 
long-term or extended-release opioid prescriptions, and followup visits. Indicators 
for both initial and chronic visits addressed avoiding co-prescribing with 
benzodiazepines and reviewing prescription drug monitoring program reports. For 
hospitalized patients treated with opioids, indicators addressed appropriate 
monitoring of respiratory status and level of sedation, rates of opioid respiratory 
adverse events, and overdoses. 

In the systematic reviews and primary studies that we reviewed, outcomes 
relevant to opioid patient safety were measured using a variety of balancing, 
outcome, and process measures. For balancing measures, studies measured 
unintended consequences of interventions-clinical outcomes such as pain scores, 
pain-related complaints or phone calls or unplanned visits, and overall satisfaction 
or specifically pain satisfaction. Emergency department visits and hospitalizations 
were measured overall or as opioid-specific occurrences. Some studies measured 
refill requests and others measured rates of opioid refills. A few studies measured 
overdose rates, serious adverse events, or mortality. 

For outcome measures, studies measured prescribing or ordering outcomes such 
as the rate of opioid prescriptions, the number of pills prescribed or refilled, the 
total dose, opioid dose reduction (for chronic pain studies), and the use of 
nonopioid analgesics. 

For process measures, studies measured process outcomes such as urine drug 
testing, opioid treatment agreement completion, prescription drug monitoring 
program reports review and achievement of guideline concordant care, and referrals 
to non-pharmacologic interventions, such as cognitive behavioral therapy or 
physical therapy. 


4.2.3, Question 3. What Opioid Stewardship Patient Safety 
Practices (PSPs) Have Been Used To Prevent or Mitigate the 
Harms Associated With Prescribed or Ordered Opioids, and 
in What Settings Have They Been Used? 


Table 3 provides an overview of the types of PSPs that have been used to 
prevent or mitigate the harms associated with prescribed or ordered opioids, and the 
settings in which they have been used. 
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Table 3. Overview of opioid stewardship patient safety practices and settings 


Intervention Category 


Intervention 


Identified Evidence and Settings 


Interventions focused on 
opioid stewardship 
involving organizational 
leadership and policies 
within a healthcare 
facility or healthcare 
system 


Clinical decision support or 
electronic health record 
interventions 


Opioid stewardship committees None 


We identified five systematic reviews!®?!23246 and three 
primary studies.?°°° 

These types of interventions addressed the approach of 
decreasing the default opioid prescribing in electronic 
health records in inpatient, emergency department, and 
primary care and dentistry settings. 

One study examined an algorithm for headache care in 
the emergency department. 


Protocols or care bundles, which 
may address components such 
as treatment agreements, urine 
drug screening, risk assessment, 
and/or naloxone prescribing 


One systematic review” addressed protocols where 
opioids consumed in the hospital guided prescribing at 
discharge; no primary studies addressed this topic. 


Interventions focused on 
clinical knowledge, 
expertise, and behavior 
related to prescribed or 
ordered opioids 


Interventions focused on 
patient and family 
education, or 
engagement related to 
use of prescribed or 
ordered opioids 


Clinician education or academic 
detailing 


We identified four systematic reviews, '*!7 22.23 generally 
addressing opioid prescribing at discharge, and no 
recent primary studies. 


Clinical pharmacist consultation 


We identified two systematic reviews, '®¢ in outpatient 
or community pharmacy settings (mostly review of 
charts) and pharmacist assistance with prescriptions in 
postsurgical prescribing, and no recent primary studies. 


Increased access/ emphasis on 
nonopioid or multimodal 
analgesia, and/or limits on opioid 
prescribing/ordering 


We identified three systematic reviews '+!%° addressing 
opioid replacement treatment (defined as transition to 
maintenance therapy and then weaning off) and 
deprescription methods (which may or may not include 
alternative pain management techniques) for chronic 
pain in ambulatory settings; procedures for developing 
coordinated recommendations for opioid prescribing; 
and increasing opioid-free prescribing, often with 
nonopioid analgesia and related patient counseling, in 
postoperative care. We identified no recent primary 
studies for this intervention category. 


Healthcare organization 
guidelines (about limiting the 
amount of opioids per 
prescription) 


Patient and family education, or 
engagement intervention 


We identified three systematic reviews 7*?3¢ regarding 
opioids and/or emphasis of nonopioid pain medications 
specific to surgery and hospital discharges. 

We found one recent primary study standardizing opioid 


prescribing guidelines for mastectomy care.*! 


We identified six systematic reviews!*!°!9.222627 and six 
primary studies.*?>’ These interventions included a 
variety of counseling and educational interventions in 
different settings about pain, opioids, and alternative 
options, including perioperative care and chronic pain 
management. 


Interventions focused on 
tracking, monitoring, and 
reporting performance 
data related to 
prescribed or ordered 
opioids 


Clinical audits 


We identified one systematic review”! addressing 
studies of safety monitoring of patient-controlled 
analgesia and prescription appropriateness, and no 
recent primary studies. 


Dashboards 


Prescriber feedback 


None 


None 
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Intervention Category 


Intervention 


Identified Evidence and Settings 


Interventions focused on 
clinical accountability 
related to prescribed or 
ordered opioids 


Peer comparison 


We identified one systematic review.”* evaluating peer 
comparison in the emergency department and one 
primary study** comparing dashboards and notifying 
facilities of consequences if performance targets were 
not met. 


Multicomponent 
interventions focused on 
opioid stewardship 


Multicomponent interventions 
(defined in MHS III as guideline- 
recommended clinical 
interventions or processes plus 
implementation strategies) 


We identified one overview of systematic reviews,”° 
three additional systematic reviews,!®?!3 and eight 
recent primary studies (reported in 9 articles).*?-*” 

One type of multicomponent interventions in hospital 
settings included elements such as system policies on 
opioid prescribing, workflow changes, and dashboards, 
in addition to prescriber or patient education. The other 
type of multicomponent interventions, covering the 
primary studies and mostly in ambulatory settings, 
included prescriber education, case management and 
improved access to alternative resources, and patient 
education and/or nonpharmacological pain 
management support. 


4.2.4 Question 4. What Is the Rationale for the Opioid 


Stewardship Practices That Have Been Used To Prevent or 
Mitigate the Harms Associated With Prescribed or Ordered 
Opioid? 

No theoretical frameworks or formal logic models for interventions were 
reported in any of the included reviews or primary studies. Motivations for 
engaging in the work included the 2016 guideline from the CDC or other national 
guidance to reduce opioid access.*?** Justifications for interventions included 
either previous pre/post studies or randomized controlled trials (RCTs) 
demonstrating efficacy of interventions for opioid stewardship??°0°3>363945 
efficacy of similar interventions for other types of care improvement projects. 
42 


or 
33,36,40- 


4.2.5 Question 5. What Are the Effectiveness and 
Unintended Effects of Opioid Stewardship Practices, and 
What New Evidence Has Been Published Since the Search 
Was Done for the Making Healthcare Safer (MHS) III Report 
in 2019? 


The limited search in the MHS III report included one systematic review and 14 
studies, two of which were RCTs, and found that the majority of studies evaluated 
multicomponent interventions including guideline implementation. Other studies 
evaluated electronic health record tools such as decision support, alerts and 
prescription drug monitoring program implementation, dashboards for monitoring 
and/or feedback, clinician education, opioid committees, and case management. 

The MHS III report concluded that overall, SOE for significant reductions in opioid 
dosage was moderate; for clinical outcomes, only two studies evaluated reduction in 
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overdoses, with neither having a significant effect. The systematic review included 
in the MHS III report (published in 2010) evaluated opioid treatment agreements 
and urine drug testing in chronic pain and concluded that the strength of evidence 
was relatively weak for reducing opioid misuse.*° Given the limited search in MHS 
III, we summarize the full literature from our search from 2016 forward instead of 
relying on a comparison to the MHS III review. 
We identified 14 systematic reviews since 2019 (1 overview of systematic 
reviews and 13 reviews), and 13 RCTs (reported in 14 articles), and 6 
nonrandomized studies since 2016 that assessed the effectiveness and unintended 
effects of opioid stewardship practices. We present the findings by intervention type 
(Table 4). We first discuss the evidence from systematic reviews, followed by 
evidence from primary studies (RCTs and nonrandomized studies with a 
comparison group). A detailed summary of benefits and harms from included 
systematic reviews and primary studies is provided in Appendix C, Evidence Tables 
C-2 through C-9. 
A list of pre-post studies is in Appendix C (see Evidence Table C-50). 


Table 4. Overview of evidence by intervention type for primary studies 
Intervention Category Intervention No. of SRs_| No. of Primary Strength of Evidence® 
Studies and Key Findings 
Based on Primary 
Studies 
Interventions focused on Opioid stewardship 0 0 Insufficient 
opioid stewardship committees 
involving organizational Clinical decision support or | 5'62123.24.26 2 RCTs”?*0 Low 
leadership and policies electronic health record 4 nonrandomized | « No change in 
within a healthcare facility interventions study?8 healthcare utilization 
or healthcare system e Decreased opioid 
prescribing 
Protocols or care bundles, | 173 0 Insufficient 
which may address 
components such as 
treatment agreements, 
urine drug screening, risk 
assessment, and/or 
naloxone prescribing 
Interventions focused on Clinician education or 416,17,22,23 0 Insufficient 
clinical knowledge, academic detailing 
expertise, and behavior Clinical pharmacist 2 18:26 0 Insufficient 
related to prescribed or consultation 
ordered opioids Increased access/ 3 1416.26 0 Insufficient 
emphasis on nonopioid or 
multimodal analgesia, 
and/or limits on opioid 
prescribing/ordering 
Healthcare organization 372,23,26 1 nonrandomized | Insufficient 


guidelines (about limiting 
the amount of opioids per 
prescription) 


study?! 
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Intervention Category Intervention No. of SRs_ | No. of Primary Strength of Evidence’ 
Studies and Key Findings 

Based on Primary 
Studies 

Interventions focused on Patient and family 614,16,19.22,26.27 | & RCTs3237 Low 

patient and family education, or engagement e Nochange in pain 

education, or engagement intervention e Mixed results for 

related to use of prescribed opioid prescribing 

or ordered opioids 

Interventions focused on Clinical audits 1?! 0 Insufficient 

tracking, monitoring, and Dashboards 0 0 Insufficient 

reporting performance data 

related to prescribed or 

ordered opioids 

Interventions focused on Prescriber feedback 0 0 Insufficient 

clinical accountability Peer comparison 174 1 RCT? Insufficient 

related to prescribed or 

ordered opioids 

Multicomponent Multicomponent 4(1 4 RCTs (reported | Low 

interventions focused on interventions* overview of | in 5 articles)*°*?*° | ¢ Unchanged or 


opioid stewardship 


S Rs) 16,20,21,23 


4 nonrandomized 
studies*#3:44:46.47 


improved pain 
e Decreased opioid 
prescribing 


RCT = randomized controlled trial; SR =systematic review 
“Low strength of evidence indicates limited confidence that the estimated association lies close to the true association, and 
insufficient strength of evidence indicates that evidence is unavailable or does not permit a conclusion. 
*Multicomponent interventions are defined as in MHS III as guideline-recommended clinical interventions or care processes plus 


implementation strategies. 


Risk of Bias 
Several types of risk of bias were present in the included RCTs based on our 
assessments using the Cochrane Collaboration’s tool.'° The most common potential 

cause of bias was lack of details about allocation and blinding in the majority of 
studies. Twelve of the 13 RCTs had high risk of bias (Figure 3). For the 
nonrandomized studies, our assessments using the ROBINS-I tool (Risk Of Bias In 
Non-randomized Studies — of Interventions) revealed concerns for bias in 
confounding, patient selection, measurement of outcomes, selection of reported 
results, and deviations from intended assignments.!! Five of the six nonrandomized 
studies had critical risk of bias (Figure 4). 
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Figure 3. Risk of bias assessments for randomized controlled trials included in this review* 


Risk of bias 


20080008 
0000000080080 


Study 


+ 4 a 


+ + + - 


D1: Random sequence generation Judgement 
D2: Allocation concealment 3 

D3: Blinding of participants and personnel @ Hion 
D4: Blinding of outcome assessment - Unclear 
D5: Incomplete outcome data 

D6: Selective reporting “+ Low 


07: Other sources of bias 
*The figure was created using the robvis visualization tool*® 


Figure 4. Risk of bias assessments for nonrandomized studies included in this review* 
Risk of bias domains 


Domains: Judgement 

D1: Bias due to confounding. a 

D2: Bias due to selection of participants. @ Ciiticar 
D3: Bias in classification of interventions. @ Serious 
D4: Bias due to deviations from intended interventions. 

D5: Bias due to missing data. ic Moderate 
D6: Bias in measurement of outcomes. @ Low 


D7: Bias in selection of the reported result. 
? No information 


*The figure was created using the robvis visualization tool*® 
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4.2.5.1 Interventions Focused on Opioid Stewardship 
Involving Organizational Leadership and Policies Within a 
Healthcare Facility or Healthcare System 


Intervention categories in this section include opioid stewardship committees, 
clinical decision support or electronic health record interventions, and protocols or 
care bundles. 


4.2.5.1.1 Opioid Stewardship Committees 


No studies met our inclusion criteria for addressing opioid stewardship 
committees alone. 


4.2.5.1.2 Clinical Decision Support or Electronic Health Record 
Interventions 


Five systematic reviews addressed clinical decision support or electronic health 
record interventions.'©?!3.746 Clinical decision support at the point of care'® and 
reduced default number of prescribed opioid pills in the electronic health record??*° 
were associated with reduced opioid prescribing. One systematic review found a 
significant decrease in opioid prescribing with reduced default electronic health 
record opioid prescribing quantity, including the finding from interrupted time series 
studies of a reduced rate of opioid prescription at 6 months (change -11.65; 95% 
confidence interval (CI): -29.30 to 5.99).4 

Providing decision support at the point of care'® was associated with reduced 
emergency department (ED) visits. Reducing the default number of opioid pills in the 
electronic health record”° was not associated with a significant increase in opioid 
requests. A systematic review addressing computerized order entry in acute care 
found that its use was associated with lower rates of respiratory depression from 
opioids.”! Neither of these systematic reviews graded the SOE. 

We also identified two RCTs” and one nonrandomized study assessing clinical 
decision support or electronic health record interventions (Table 5).”* Both RCTs 
compared the effect of modifying opioid prescribing defaults in the electronic health 
record to preexisting defaults. One RCT evaluated a default of prescribing a dispense 
quantity of 10 tablets compared to no change in preexisting defaults in a large health 
system’s primary care practices and emergency departments.” The other RCT 
compared defaults of 10 tablets, 5 tablets, or no change to preexisting defaults within 
a health system’s dentistry practices.*° Both RCTs evaluated clinical outcomes 
including outpatient visits, emergency department visits, and hospitalizations during 
the 30-day period after the index prescription. Neither RCT found statistically 
significant differences in healthcare utilization.??°° The one RCT in dentistry 
practices found a statistically significant increase in opioid prescription reordering in 
both the 5 tablet and 10 tablet groups compared to control.*° There was no difference 
in opioid prescription reorders in the second RCT based in primary care and 
emergency departments.”? 


6 
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Both RCTs found that the 10 tablet intervention groups (default dispense 
quantity) were statistically significantly more likely to have prescriptions for 10 
tablets or fewer be prescribed fewer tablets at baseline and have a lower total 
morphine milligram equivalents (MME) per day prescribed at baseline. The RCT in 
the dentistry practice sustained these statistically significant differences at 30 days 
while the RCT in primary care and the emergency department found a statistically 
significant difference at 30 days in total pills prescribed but not in total MME per 
day. The study comparing 5 tablets to control found no differences in prescriptions 
for 10 tablets or fewer at baseline, number of tablets prescribed at baseline or at 30 
days, nor in MME prescribed at baseline or at 30 days compared to control. 

Neither RCT assessed any of the process outcomes defined in our inclusion 
criteria. 

One nonrandomized study evaluated a treatment algorithm for headache in the 
ED, including diagnostic and treatment planning aids.** They compared patients in 
two post algorithm implementation periods (first six months after adoption, and then 
one year later) to historical controls. Compared to controls, patients in both post- 
implementation periods were significantly less likely to be treated with opioids or 
barbiturates in the emergency department or discharged with opioids or barbiturates. 
There were no significant differences between control and post-implementation time 
one (i.e., six months after algorithm implementation) groups in post-treatment pain 
scores, frequency of imaging, consults, or admissions. Findings were similar for post- 
implementation time two (i.e., one year after algorithm implementation) except for a 
significant increase in the number of neurology consults and admissions when 
compared to the control group. 

We graded the SOE as low for healthcare utilization and low for opioid 
prescribing. 
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4.2.5.1.3 Protocols or Care Bundles (Which May Address 
Components Such as Treatment Agreements, Urine Drug Screening, 
Risk Assessment, and/or Naloxone Prescribing) 


One systematic review assessed protocols that used the amount of prescribed 
opioids used for hospitalized patients to guide discharge prescribing.”? This review 
found that the protocols resulted in reduced quantities of opioid prescribed at 
discharge. We did not identify any systematic reviews or recent primary studies 
addressing care bundles. 


4.2.5.2 Interventions Focused on Clinical Knowledge, 
Expertise, and Behavior Related to Prescribed or Ordered 
Opioids 


Intervention categories in this section include clinician education or academic 
detailing, clinical pharmacist consultation, increased access/emphasis on nonopioid or 
multimodal analgesia and/or limits on opioid prescribing/ordering, and healthcare 
organization guidelines. 


4.2.5.2.1 Clinician Education or Academic Detailing 


Four systematic reviews addressed clinician education or academic detailing 
alone.'®'”23 Three of these reviews reported an association with reduced opioid 
prescribing after the intervention.!®!”3 For clinical outcomes, systematic reviews did 
not find an increase in refill requests,’ or pain-related complaints,'’ but found an 
increase in number of patients returning to the emergency department within 30 days 
for pain control.”? Only one of the systematic reviews graded the quality of evidence, 
and determined it to be low for a group of interventions that included this category.'® 


4.2.5.2.2 Clinical Pharmacist Consultation 


Two systematic reviews addressed clinical pharmacist consultation.'®?° The 
interventions addressed clinical pharmacist interventions in outpatient or community 
pharmacy settings (mostly review of charts)'® and pharmacist assistance with 
prescriptions in postsurgical prescribing.*° Both reviews found an overall reduction in 
overall opioid dose after pharmacist intervention'*”® and one study included in this 
review found an increase in nonopioid analgesics. !* 

For clinical outcomes, one review found that 5 of 8 studies showed significant 
reduction in pain intensity!* and the other review found no increase in post-operative 
pain,”° and no increases in hospital visits.° 

For process outcomes, one study found an increase in physical therapy referrals. !* 

Neither of these systematic reviews graded the SOE. 
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4.2.5.2.3. Increased Access/ Emphasis on Nonopioid or Multimodal 
Analgesia and/or Limits on Opioid Prescribing/Ordering 


We identified three systematic reviews addressing this type of intervention.'*!°° 


These reviews found that opioid replacement treatment (defined as transition to 
maintenance therapy with a different opioid and then attempting to taper down the 
opioid) showed no significant difference for opioid dose.'* The reviews also found 
that deprescribing methods in ambulatory chronic pain (with or without nonopioid 
pain management techniques), coordinated recommendations for opioid prescribing, 
and increasing opioid-free prescribing (often with nonopioid analgesia and related 
patient counseling) all reduced opioid dose or prescribing.'*'°° The review on 
opioid-free prescribing found results for clinical outcomes, with no differences in 
pain, requirement for additional prescriptions, or satisfaction.”° One of these reviews 
graded the SOE and found moderate level certainty for the outcome of opioid dose 
reduction based on a single study. 


4.2.5.2.4 Healthcare Organization Guidelines 


Three systematic reviews addressed healthcare organization guidelines for opioids 
and/or emphasizing nonopioid pain medications in surgical or hospital 
discharge.””> All three found decreases in prescription size and doses.””” For 
clinical outcomes, there was generally improvement in pain, no difference in patient 
satisfaction or phone calls for uncontrolled pain, and mixed results for refills or 
requests.??73-76 

We identified one primary study of a quality improvement project assessing 
patient use of post-operative medications; patient satisfaction with their pain 
management; and standardizing opioid prescribing guidelines for patients undergoing 
mastectomy with immediate reconstruction.*! Across the phases, the overall amount 
of opioids prescribed per patient was reduced (median of 450 MMEs per day in Phase 
I, and 98 MMEs per day in Phase IV). The range of the amount of prescribed opioids 
across patients was reduced from the beginning to end of the project (225 to 925 
MMEs per day in Phase I, and 0 to 250 MMEs per day in Phase IV). Across phases, 
patient satisfaction fluctuated, starting at 93% of patients reporting high satisfaction 
in Phase I (baseline), 83% in Phase II, 73% in Phase III, and 93% in Phase IV. 

We determined that the SOE was insufficient. 
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4.2.5.3 Interventions Focused on Patient and Family 
Education or Engagement Related to Use of Prescribed or 
Ordered Opioids 


Six systematic reviews addressed patient and family education or engagement 
interventions. !4'°-!9.22.2627 Specific interventions included a variety of counseling and 
educational interventions in different settings, including perioperative care and 
chronic pain management, and pain self-management and tapering down opioids. 

Four of the five reviews that addressed opioid dose prescribing found 
significantly reduced doses or discontinued therapy;'*!°*6 the other review found 
no difference in a single study.'? All of the five systematic reviews addressing pain 
found reductions in pain intensity!*!*!??° and the one review that addressed opioid 
refill requests found no difference, with low level of certainty.”’ One systematic 
review focusing on long-term management of chronic pain'* found that patient and 
family education or engagement interventions that included pain self-management 
with tapering down opioids moderately reduced opioid dose (mean difference in 
MME per day —14.31 (95% CI, —21.57 to —7.05) compared to no intervention, with 
moderate level of certainty. The review found a moderate effect on pain intensity 
(standardized mean difference —0.59 (95% CI, —1.02 to —0.16), with low level of 
certainty). 

We identified six RCTs that addressed patient and family education or 
engagement intervention. We report the findings from these six RCTs by outcomes 
below (Table 6). 


4.2.5.3.1 Clinical Outcomes 


Six RCTs assessed the effect of patient and family education or engagement on 
clinical outcomes (Table 6).373 In general, RCTs evaluated education-related 
interventions (such as pain expectations, use of opioids for pain including risks, and 
the use of nonopioid analgesics) compared to previously established standard of care 
perioperative education or counseling. Two studies included a shared decision- 
making model which incorporated patient expectations of how many opioid tablets 
they believe they should receive after surgery in subsequent prescribing.*°?” All 
studies were conducted in the ambulatory surgery setting. All six RCTs assessed 
multiple clinical outcomes including pain, patient satisfaction, healthcare utilization, 
and opioid refill requests (Table 6). 

Five of the six RCTs assessed pain as a clinical outcome.*?*>*” Four of the RCTs 
found no statistically significant differences in pain between groups. 

One RCT compared opioid related postoperative education to standard of care in 
patients undergoing primary arthroscopic rotator cuff repair.** They found 
statistically significantly lower pain scores in the study group compared to the control 
group at 2 weeks and 6 weeks, with no significant difference at 3 months. 
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Four of the RCTs evaluated opioid refills.**7>?” One RCT in patients undergoing 
ambulatory hand surgery found statistically significantly higher opioid refills in the 
control group compared to the intervention group.*> Another RCT in patients 
undergoing mastectomy with immediate, implant based breast reconstruction did not 
identify a difference between groups.*? The two RCTs that included shared decision 
making around total opioid tablets prescribed found conflicting results.*°?’ One study 
of patients undergoing minimally invasive hysterectomy reported more refills in the 
patient directed arm compared to the control group.*° The other study of patients 
undergoing isolated mid-urethral sling placement found no statistically significant 
differences in refills between groups.>’ 

Three of the RCTs assessed patient satisfaction.***” Only one RCT found 
statistically significant differences, with the intervention group being more likely to 
be satisfied with their pain management.*> 

Two RCTs evaluated healthcare utilization.*4°° One RCT evaluated unexpected 
visits to the emergency department or to the office due to uncontrolled pain and found 
no differences between groups.*° The other assessed for “serious adverse events” 
defined as those that led to a call or unplanned return visit to the clinic or hospital 
setting. There were no differences between groups.*4 

We determined the SOE to be low for the outcome of pain. 


4.2.5.3.2 Opioid Prescribing or Ordering Outcomes 


Five of the six RCTs evaluating patient and family education or engagement 
interventions assessed opioid prescribing or ordering outcomes (Table 6). All five 
assessed opioids prescribed after surgery, with mixed results. Three of the five had no 
significant differences between groups in opioids prescribed or dispensed.***> The 
two studies comparing a shared decision-making model with standard of care did 
report a statistically significantly lower amount of opioids post-operatively in the 
intervention arm compared to the control group.*°°7 

One RCT also evaluated inpatient MME doses and found no differences between 
groups.*° 

We determined the SOE to be low for the outcome of opioid prescribing. 


4.2.5.3.3 Changes in Process Outcomes 


None of the RCTs evaluating patient and family education or engagement 
interventions assessed the process outcomes defined in our inclusion criteria. 
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4.2.5.4 Interventions Focused on Tracking, Monitoring, and 
Reporting Performance Data Related to Prescribed or 
Ordered Opioids 


Intervention categories in this section include clinical audits and dashboards. 
4.2.5.4.1 Clinical Audits 


One systematic review addressed patient-controlled analgesia safety monitoring 
in acute care and found a decreased overdose rate in one study.”! This review found 
no change in opioid prescribing. The review did not grade the SOE. 


4.2.5.4.2 Dashboards 


No studies met our inclusion criteria for addressing dashboards alone. 


4.2.5.5 Interventions Focused on Clinical Accountability 
Related to Prescribed or Ordered Opioids 


Intervention categories in this section include prescriber feedback and peer 
comparison. 


4.2.5.5.1 Prescriber Feedback 
No studies met our inclusion criteria for addressing prescriber feedback alone. 
4.2.5.5.2 Peer Comparison 


One systematic review found that in interrupted time series studies there was a 
reduced rate of opioid prescribing with a change of -28.10 (95% CI, -44.83 to 
-11.38), and in a combined analysis of pre-post studies, cohort studies and RCTs 
there was a reduced rate of opioid prescribing, OR 0.46 (95% CI, 0.29 to 0.72).4 
The review did not grade the SOE. 

We also identified one RCT that assessed an intervention focused on clinical 
accountability related to prescribed or ordered opioids.*® This study randomized 
Veterans Health Administration (VHA) facilities to receive a notice describing a 
new dashboard based on the Stratification Tool for Opioid Risk Mitigation 
(STORM). It also described the importance of risk mitigation strategies and 
mandated case review. The intervention arm received the same notice with an extra 
paragraph stating that facilities which did not meet a target of 97 percent case 
reviews would receive technical assistance and be required to submit an action plan 
on improving the review rate. The RCT found no statistically significant difference 
in serious adverse events or death between groups (hazard ratio (HR) 1 (95% CI, 
0.91 to 1.09) for all-cause mortality and 1.03 (95% CI, 0.97 to 1.08) for any serious 
adverse event). The RCT did not evaluate opioid prescribing or process outcomes. 

We determined the SOE to be insufficient for the outcome of serious adverse 
events. 
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4.2.5.6 Multicomponent Interventions Focused on Opioid 
Stewardship 


We identified one overview of systematic reviews and three additional 
systematic reviews that addressed multicomponent interventions. 

The overview of systematic reviews 7° focused on patient-targeted interventions 
for opioid prescribing in any setting and included 4 reviews published from 2011 to 
2021. These reviews focused on chronic pain in ambulatory settings and (a) 
multidisciplinary pain programs>’>?’ and (b) multicomponent tapering down opioids 
support interventions, such as dose reduction protocols, opioid replacement, and 
nonpharmacologic therapies.°” For opioid outcomes, multidisciplinary pain 
programs were consistently associated with reduced opioid prescribing compared to 
usual care,°’°* with low certainty of evidence.”° One review concluded that tapering 
down opioids support programs were consistently associated with reduced opioid 
prescribing compared to usual care.**® The other review found that patient-focused 
interventions were not associated with opioid dose reduction in the intermediate 
term and did not increase the number of individuals able to stop opioids; the 
certainty of evidence was low.”° One of the systematic reviews also addressed 
multicomponent clinician-focused interventions consisting of training plus decision 
tools, and identified one study that reported a statistically significant difference in 
opioid dose reduction.” 

For clinical outcomes, both types of patient-targeted interventions showed 
improved or unchanged pain,°’>? with low certainty of evidence.”° 

Three additional systematic reviews addressed multicomponent 
interventions.!°!3 These interventions often included clinician education as well 
as system policies or guidelines on opioids and emphasized nonopioid approaches, 
protocols, audit and feedback, and patient involvement. System policies combined 
with other interventions were associated with decreased opioid prescribing. These 
multicomponent interventions included policy limits on number of opioid pills 
prescribed together with, clinician education,'®*! discharge prescribing workflow 
changes,”* and adverse event monitoring with computerized order entry or opioid 
safety guidelines. There were mixed results on the effect of multicomponent 
interventions in acute care on opioid prescribing, but an increase in nonopioid 
analgesic use. These multicomponent interventions included clinician education 
emphasizing nonopioid approaches in addition to protocols, audit and feedback or 
patient involvement.”! 

For clinical outcomes, system policies of number of opioid pills prescribed 
together with and clinician education'® was associated with no significant difference 
in pain intensity. There were mixed results associated with the effects of 
multicomponent interventions including clinician education (emphasizing 
nonopioid approaches and protocols), audit and feedback, or patient involvement”! 
on hospital length of stay. The multicomponent interventions were associated with 
reduced hospital readmissions and increased patient satisfaction with pain 
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treatment. Adverse event monitoring combined with computerized order entry or 
opioid safety guidelines”! had no change in hospital length of stay or mortality. 

Eight primary studies (reported in 9 articles) addressed multicomponent 
interventions (Table 7)]. We report the findings from these primary studies by 
outcomes below. 


4.2.5.6.1 Clinical Outcomes 


Four RCTs described in five articles and four nonrandomized studies assessed 
the effect of multicomponent interventions on clinical outcomes (Table 7). These 
multicomponent interventions most typically involved a combination of opioid 
education to prescribers, academic detailing, nurse care management and facilitated 
access to additional specialists. The majority of RCTs*?***> were conducted on 
ambulatory care patients on long-term opioid therapy. One RCT was conducted 
with adult patients who visited an emergency department more than 10 times over a 
12-month period, with at least two of those visits attributed to pain or “drug-seeking 
behaviors."*? One RCT conducted in the emergency department focused on two 
components: a case manager and a multidisciplinary collaboration to develop 
individualized plans for providers to access the next time the patient presented to 
the emergency department.*? 

Four RCTs assessed several clinical outcomes including opioid refills, pain, 
patient satisfaction and healthcare utilization. Two RCTs described in 3 articles 
reported on opioid refill requests.*°“” There were no differences in early refill 
requests between groups in either study.*°4! 

One RCT (reported in 2 articles) assessed patient satisfaction.*!*” There were no 
differences between groups in high patient satisfaction (defined as a score in the top 
quartile) or high patient trust in provider (defined as a score in the top quartile). 

Two RCTs (reported in 3 articles) reported on pain outcomes with no 
differences identified between groups in either study.*!*?*> One RCT*’ conducted 
in emergency departments reported on healthcare utilization and found the 
intervention group experienced a decrease in the incidence of emergency 
department visits over the 12-month study period and had a lower average number 
of emergency department visits over the study period. 

One nonrandomized study evaluated the impact of the VHA’s Opioid Safety 
Initiative (OSI) on opioid prescribing patterns and opioid toxicity.*+ The OSI 
comprised five components: (1) prescribing dashboards which aggregated and 
reported opioid prescribing on the facility-, provider-, and patient-level; (2) clinical 
practice guidelines for safe prescribing; (3) provider education; (4) a 
complementary integrative health initiative; and (5) a stepped care model and pain 
management teams. A second nonrandomized study evaluated the VHA’s Whole 
Health Primary Care Pain Education and Opioid Monitoring Program (PC-POP) for 
patients seen in primary care who receive long-term opioid therapy for chronic 
noncancer-related pain.*” PC-POP includes components such as chart review, 
education, evaluation (patient self-assessments of anxiety, depression, physical 
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functioning, drug use/abuse, and quality of life), prescription and action (e.g., 
treatment planning and follow up) implemented by a multidisciplinary care team. 
Two nonrandomized studies evaluated opioid stewardship interventions in surgical 
services. One study prospectively evaluated the impact of opioid minimizing and 
opioid eliminating strategies in surgical patients undergoing inguinal hernia repair 
or cholecystectomy. Patients were grouped into one of three conditions: (1) control 
in which patients received standard of care with no changes, (2) opioid-sparing in 
which patients received patient education, perioperative multimodal analgesia, and 
opioid prescription at discharge, and (3) zero-opioid wherein patients received the 
same opioid-sparing protocol but were not provided an opioid prescription at 
discharge.*° The second surgical services study reported the results of a quality 
improvement study evaluating the implementation of an opioid-free discharge 
protocol in patients undergoing ureteroscopy for urolithiasis.*7 The protocol 
included medication and patient counseling interventions at five stages of 
perioperative care: pre-operative clinic, preoperative surgical staging, 
intraoperative, postanesthetic care, and discharge. 

Four nonrandomized studies, two conducted in the outpatient setting***’ and 
two in surgical services,‘*“° included patient reported outcomes or emergency 
department utilization and hospital admission outcomes. A segmented regression of 
pre-OSI (n = 19,382) and post-OSI (n = 22,682) opioid naive patients treated for 
prostate, lung, breast or colorectal cancer at a VHA facility revealed a statistically 
significant increase in pain-related emergency department visits in post-intervention 
patients.** There were no significant differences between PC-POP enrollees (n = 
423) and non-enrollees (n = 311) in emergency department visits or inpatient 
hospitalizations.*” One study conducted in surgical services found no significant 
differences in patient-reported pain scores or satisfaction two weeks post- 
discharge.*° The other study found no differences in emergency department visits 
between groups.** 

We determined the SOE to be low for the outcome of pain. 


4.2.5.6.2, Opioid Prescribing or Ordering Outcomes 


Three RCTs*?4°*> reported on opioid prescribing or ordering outcomes [Table 
7]. Two RCTs found statistically significant decreases in opioid prescribing.*?*° 
One RCT, targeting interventions in emergency departments, found a decrease in 
the odds of receiving an opioid prescription from an emergency department 
provider as well a smaller average number of opioid prescriptions written over 12 
months in the intervention group compared to controls. Another RCT, in primary 
care, identified an adjusted difference in daily opioid dose of -6.8 MME (p < 
0.001). Another third RCT, in primary care, found no difference in prescription 
opioid dose in MME at final visit.** 

Three nonrandomized studies reported opioid prescribing or ordering outcomes. 
The study evaluating the VHA’s OSI program found a statistically significant 
decrease in the monthly rate of new opioid prescriptions after OSI 
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implementation.“ Evaluation of the PC-POP program revealed no significant 
differences between PC-POP enrollees and non-enrollees in suboxone doses or 
MME daily dose.*” One study in surgical services found enrolled patients were less 
likely to have an opioid prescription at discharge as well as significantly lower 
morphine equivalent doses.” 

We determined the SOE to be low for the outcome of opioid prescribing. 


4.2.5.6.3 Changes in Process Outcomes 


Two RCTs reported in 3 articles assessed process outcomes including urine 
drug testing, presence of an opioid treatment agreement, prescription drug 
monitoring program reports review, and achievement of guideline concordant 
care.*°4? Both RCTs assessed use of urine drug screening and opioid treatment 
agreements. Both RCTs found that the intervention arm was more likely to undergo 
urine drug testing (71% versus 20%, adjusted OR 13.38 (95% CI, 5.85 to 30.6) in 
one study, and 74.6% versus 57.9%, p < 0.001 in the other study) and was more 
likely to have a signed treatment agreement (adjusted OR 61.5 (95% CI, 15.3 to 
247.2) in one study, and 53.8% versus 6%, p < 0.001 in the other study) when 
compared to controls. 

One RCT evaluated achievement of guideline concordant care (defined as urine 
drug testing and presence of an opioid treatment agreement) and found that the 
intervention group was more likely to have guideline concordant care than controls 
(65.9% versus 37.8%, p < 0.001).*° 

Another RCT assessed for use of the prescription drug monitoring program and 
found no statistically significant differences between groups (adjusted OR 3.85 
(95% CI, 0.99 to 14.93).414 

One nonrandomized study included process outcomes.*’ The study evaluating 
the PC-POP program found rates of naloxone prescriptions, urine drug screens, 
STORM reports generated, assessments for mental health, substance use, and well- 
being were significantly more frequent for PC-POP enrollees when compared to 
non-enrollees (p < 0.001 for all comparisons). No difference in prescription drug 
monitoring program reports were found between groups (p = 0.428). Enrollees were 
also more likely to be referred to nonpharmacological treatment (i.e., cognitive 
behavioral therapy for chronic pain, whole health, living with chronic conditions, 
and trauma sensitive yoga) than non-enrollees (p < 0.001 for all comparisons) 
except for mindfulness center referrals which showed no difference in between 
enrollees and non-enrollees (p = 0.132). 

We did not grade the SOE for process outcomes. 


Making Healthcare Safer IV — Opioid Stewardship 


diyspuemays pioido — Aj 4ayeS sseoyyeaH Burjey\ 


pavojie} Jabeuew 


(ZL) €°S9 ayeo asinu ay] “uoeonpe 
SA (€9L) 6 79 ‘SYJUOW 9 aplAoid 0} sjuaed YM jouw 
oyum Jebeuew aed asunu e (Z) 
($°SL) 8°S9 2G°0=d ‘(j0.4U0d) (7°77) ‘BuyoyuoW eoueseype plo|do 
SA(G'PL) 29 ‘ouljeseg 9'EE SA (UONUSAJ9AU!) Z91'0=d | uoNdiwoseid Bulpunowns eseo Jel} }oujUOD 
(9've) pve =HNSEY | ‘(104jUOd) (E°G9) E'ZE | Pese}Uso-JUeHed UO SUB!OIUIID | peziwopueL 
JosjuoD (as) ueow SA (UONUSAJ9}U!) JO} UOISsas JeuOHeonps Ja}sn|O 
SA UONUSAJO}U] = YNSOY | ‘WSIA Jeuly ye S}UsTeAINbS (LS) 8:97 = }INSOY inou-z (1) Jo Buysisuoo 
(qs) ueow aulydiow Bw ul (as) ueow ‘qa uojuaAlajul Adesay ploido srCZOS 
MN MN ‘9109S Ajisudajul Uleg | 9SOp ploido uONdWISald ul asop ploido Jo Ayayes au} BulAosduuy| ‘OOSEIOW 
Le 0=d 
‘(eb 01 ZE°0) 79'0 = INSeY 
zZ'0=d ‘(S6"L (ID %S6) 
0} yeL-) €'0 =3INsey | UO pejsnipe ‘syjuow 7) 
Z2'0=4 ‘(92'% | (ID %S6) HO paysn{pe 48AO S]]YO1 Aj1ed JO “ON 
0} G0) APL = HNsoy ‘9oUdJapIOUI Uled 
(ID %G6) euesayyIp LZ’ 0=d ‘(]04jU09) 
ueow pajsnipe | = 7/'0=d ‘(jo4ju09) (gg°e) | (vL'L) 9°0 SA (UOMUeAJO4UI) 
‘(OL - | eBues 66'P SA (UOHUBAJBIU!) (L) 90 = WNseYy 
‘ajuacsed %G /) (962) 2°G =}INsoy (ds) ueew ‘syjuow 7) 
ured sobeuew d1ul|9 (as) ueow J9AO S||1Ja1 Alea JO “ON 
ay} Aem oy} YUM ‘Q0uUdJapO}U! Uled 
uoloRjsijes jua}ed Lb O=d (SLL 
L6'0=d ‘(g2"1 0} 970) SS°0 = INSOY “sysijeloeds 
ZZ 0=d 0} 9G'L-) L'0 = Hnsoy (ID %S6) YO juawjeo.] UOOIppe 
‘(j04jU09) (¢°9) (ID %S6) HO | paysnfpe ‘syjuow Z) 1900 0} ss900e pajey|ioe} (¢) [2143 [O4jU00 
ZZ SA (UOHUSAa}U!) | paysn[pe ‘A}IaAeS Ue S]|os Ajseo 910 JO 1 pue ‘Hurjlejap siwepeoce pue peziwiopuel 
(v'yG) Le = Nsey uoljeonpe ploido (Z) :sjuayjed Jaysnio 
(%) u (OL - | eBues L6 0=d ‘(J04}U09) (29°Z) LL'O=d ‘(Jo4}U09) aBeuew 0} Ansibes s1u0s}09)9 
‘ajjuadsed %G/) Q1'g SA (UOHUBAJEIU!) %py OE SA (UOHUSAEIUI) | ‘(1O4]U0D) (EGY) E'9E pejqeue-|| ue yim sebeuew 
ured sobeuew d1ul|9 (48°Z) €:9 =}INSOY %OLS =}NSOY SA (UONUSAJaJU!) | O1e9 Bsunu e (L) yo Busisuoo zr 1pCCOC 
ayy Aem ay} YIM (as) % ‘SyJUuoW Z} 10A0 | (80H) Bz =IINSSY | UOHUSAIOJU! AIH 40} SOUND Ul ‘nuese|od 
UN | UolRJsIVeEs JUaHe ueaul ‘A}IaAVS UIed S][os Ajseo a10W JO 1 (as) ueow ‘AW | elsebjeuy avnoeysy Bunsbuel | ‘Lzoz ‘jowes 
ubisoq 
Sa9W09}nO uoljeyUsW9|du| auljeseg Apnis 
uonezinn sawoojno -JSOd 9W09}nCO ye 9W09}NC 
aleoyyeayH | uoloejsies juaijed S9WI09}NOC Uled Buiquoseaig ploidg | Bulqiosaig pioido uo!}dII9Ssaq UO}USAJa}U] | IRSA ‘AOU}]NY 


saipnjys Arewnid 
84} Ul peyIOdas SUOIJUBAI9}U! JUBUOdWIODI}|{NW 10} S8WIOD}NO Hulsapso/Huiqioseid ploido pue S9Wi0d3}NO [edIUI]D JO MAIAJBAG “2 9IGeL 


diyspuemays pioido — Aj 4ayeS sseoyyeaH Burjey\ 


Z8 O0=d ‘(Jo1}U09) 
(L'0Z) 08 SA (UOHUeAJEUI) 


73°0=d 

‘(104}U09) (9°GZ) £79 
SA (UOHUSA9}U!) 
(678) LL9 =1INseY 
Bu 

‘(as) ueow ‘qqaiN 


(9°SL) €9 

SA(G'VL) SB “OOL < 
(9°8L) pL SA 

(6°SL) €6 ‘00l — 0S 


(2°02) ZL =4NseY | (y'79) LGZ SA (6'99) "(S]00} 
(%) U Sjjos Area 7 =< Z6E ‘0G > 0 < uoIsloap d1U04jD9|9 pue JelJ} }OuJUOD 
(€°L) GSA (1°Z) 9L0 ‘Buljeyap o1wepeoe ‘Aujsi6es | paziwopues 
L€0=d ‘(j043U09) (70g) ZZ 0=d ‘JoWUOD dluOWOg]a ‘JusUEeHbeUeW Jaysn|O 
€'Z9 SA (UOHUSAJ94U!) SA UONUSAJO}U] 9Je9 BSiNU) UOHUSAJS}UI 
(2°€6) 8°09 = yNseY = ynsey ered Alewld ul Bulquoseld orZ LOZ 
IN IN UN Bw ‘(qs) ueew ‘qqaw (%) u Bw ‘qaqa pioidg Buiwoysues | ‘qanyosqer] 
g69'0=d ‘(6'°8Z) cB SA 
(2°82) peg ‘syUOW 7} 
(6°82) €°€S 
SA (9°87) 9°GG “SUJUOW 
(82) ¥S “‘pepesu 
SA (L'8Z) Z'9g ‘auljeseg se SUONEPUSLUWODAI JO} 
JEpsJOSIP BSN souR}sqns pue 
JO4jU0D ured Burnes} ul asedx9 YIM 
SA UONUSAJ9}U] = INSOY jsiIBojoyoAsd pue juswj}e9J} 
(as) ueaw ‘ai09s ured o1uo0Jyo ul esedxa 
aouUaJOpIO}U! UIE, yy ueloisXud aulsipaw 
Jeusajul ue 0} JOBeUeW Bsed 
wZLE0=d 9@SJNuU dy} JO} ssaooe (¢) pue 
(QL) L'Z9 SA Ayayes ploido Bulaosduu! jnoge 
($°91) 67g ‘SyJUOW Z| dOd 84} 0} suoHepuswWodes 
ubisoq 
saW09}nO uoljeyusW9|du| auljeseg Apnis 
uojeZzinn so9wo09jno -JSOd 9W09}nCO ye BW09}NC 
aueoyyeoH | UOlORSI}ES jUSI}ed S9W09}NOC Uled Buiquosaig ploidg | Buiqiiosaig ploidg UuO!}dII9Ssaqg UO}USAJ9}U] | IBS, ‘AOU}]NY 


diyspsemays ploido — Aj 4ayeg aseoyyeoH Buryey\| 


“abseyosip (S) 
% ‘PSIA ueew ‘qa pue 
OIUI[D payejas ule, aBeiane abieyosip-}sog L00°0 ‘yun Jed oeU}Seuej}sod (7) 
> d ‘(Jo1jU09) %G'Sg ‘antesedoedjul (€) yoyoo 
L=d ‘(jo1JU09) %y7Z gS ‘o=d ‘(Jo1}U09) SA (UONUSAJ9}U!) ‘ease Buibeys aajoedsold 
SA (UONUSAJ9}U!) %6' | SA (UONUSAJOU!) %/'E =}INSOY jeolBins eajesedosid (Z) 
%py'L = yNsey %L'e = 3NseY % ‘abseyosip ‘WSIA O1UI}O BAesedoaid (|) 
% ‘s]]eo % ‘uoldUosaid ye uoldiuosaid :$d9}s G panjoAul ebseyosip crLZOZ 
auoyd payejal uled MN UN ploido afieyosip-}sod pioido ye joo}OJd Bayj-ploido ay ‘uewsey 
€00°0=d 
‘(10uU09) (Z0'Z) B'S 
SA (UONUSAJ9}U!) 
(S9"y) 6S'S = }INSEY 
(as) 
ueaw ‘s}ISIA G3 L000 > d ‘(sz¢e"0 
— 0710) 8610 = HINSeY ‘sqa 
L00°0 (ID %S6) YO Buyjedioiped 0} pajuasaid 
> d ‘(L78'0 — 8€S°0) ‘(ou/saf) G3 ul ploido juaijed ay} UaYyM JapiAoid 
€29°0 = }INsey 84} 0} QUI]EPINH au} pexey yey} 
(ID %&6) L00°0 > d ‘(ece'0 waysks eHueyoxe UoeUWosU! 
o1jye4 ayes JUBPIOU! — 2210) 8020 = 3INsey G3 84} Ul peyueuNsop pue 
‘(yjuow sad (ID %S6) YO seyiwwo0s Ayeuldiosipyjnu 
ou/saf) }ISIA Ga ‘(yyuow sad junod) qy L9°0=d e BIA SOUIJAPIND aed Gy 
94} Ul BQUapIoU! PloIdO | ‘(jO4j]U0D) (69'E) GO’E | Dyloeds jUaHed yo UOHeeLD (Z) 
L00°0 SA (UONUSAJ9}U!) pue ‘aed 0} SIOLWeg YIM 
> d (G/2°0 — 69S'0) L00°0 > d ‘(jojuod) (SO°Z) | (26"€) Z6°e = HNSeW \sisse 0} Jabeuew eseo Gy 
€99'0 = }INsey vb’ | SA (UOHUSAejUI) | (GS) UeeW ‘syjuOW | 94} BIA UOHeUIPJOOD e129 (|) LOU 
(ID %S6) YO (v2°0) 870 =4NseYy | Zp sod ul Gy au} JO Buyysisuo9 
‘(yyuow Jad junod) (as) ueaw ‘qa ay} Wo1 | Wo1 suolduoseaid | weiboid Gy apimAjio pajsisse 69 LOZ 
BOUaPIOU! HISIA GY UN UN suoljdiiosaid pioido ploido jo saquinn aBueyoxe-uoleuoju| ‘USAON 
29°0=d 
‘(JoUOD) (9°EZ) 76 
SA (UONUSAJ9}U!) 
(L'vZ) Spb = ynsey 
(%) 
U S]JIJo1 Ajsea Z =< 
ubisaq 
saW09}nO uoljeyUaWa|dw] auljaseg Apnis 
uojeZzinn so9wo09jno -JSOd 9W09}nCO ye BW09}NC 
aueoyyeoH | UOlORSI}ES jUSI}ed S9W09}NOC Uled Buiquosaig ploidg | Buiqiiosaig ploidg UuO!}dII9Ssaqg UO}USAJ9}U] | IBS, ‘AOU}]NY 


diyspuemays ploido — Aj 4ayeg sseoyyeaH Burjey\ 


YO!) uelpew “SII 


dU} Je JUBUOGWOD jeuoTeonpe 


ured U}IM ad1jjo ‘aBieyosip s9aye ueipaw ‘abieyosip | (yo) uelpaw ‘abseyosip daatjesadoesjul ue (2) :papnjoul jooo}old opCCOS 
s,uoaBins 0} sjeQ | Sa109s UuOORSI}eES Jaye Seasons uled Jaye AWW [E}OL je}0) | UoHUsAJE}UI UOHONpPA| ploldO ‘wwe 
L00°0 > 4 ‘(iso 
- a1d) (L - 2°0) 60 
SA (ISO - 380d) (pL 
- LL) G0 = }Insey 
suolssiwpe poj}eja 
ploido jo aduapioul 
dalzejnuind seak-¢ 9z'0=d 
‘(EL - 2 @-) 8'0- = NseyY 
€0'0=d (ID %G6) % ‘Suondiussaid 
(G-L)e =3Insey pioido asop-yBbiy jo 
(ID aBueyp jo ayes AjyJUOW 6h 0=d ‘(G1 
%G6) % ‘eBueyo jo - 20-) v0 =}nsoy 
93e4 A}YJUOW }ISIA (9-9°ZL-) Ge - =3INseY (ID %&6) "aed JO plepue}s 
Ga peyejas ued (YO1) % % ‘suoHdwosaid | jeuo!N}}SU! ay} Woy peyelAep 
‘vLOz pue 9102 Usemjeq pioido asop Jo ys ybly se paynuep! 
s9}e1 UOI}dIIDSe1d -yBiy yo abueys | susayyed Huiquosaid 0} peysye 
(ISO-2e1d €o) (9°0 ul aHueyo ueipsay jo ayes A[YJUOW | 919M SIOPIADIG ‘SUONdIOSeJd dnos6 
- 10) €'0 40 (ISO 9auldezelpozuag jue}WOOU0S uosiliedwoo 
-21d LO) (L - v0) 80 (10 (ISO @1d) (g'9¢ | pue sesop ploido Ajep yBiy se | eB ym Apnjs 
SA (ISO - 380d) (2° - 0} '0-) % €°0- = HNSOY | - 2b) L' pz =3INsey yons suojduoseid ysu-yBiy | jeuoyeAsesqo 
- 60) 8b =yNsey (ID %S6) % (aoI) Bulpnjou! ‘Buiqiioseid pioido 
(ID %S6) ‘yyuow Jad suoljdiiosaid % ‘suol}diuosaid uo eyep jargj-Ayoe} pue 
BOUSPIOUI ‘S}ISIA ploido mau 40} ploido | ‘-ueloiulo ‘-juaned peyebosb6e rrCTOS 
G3 payejai uleg MN UN aBueypd jo aze1 AjujUOW | Mau jo 2a}e1 UeIPAW pseoqusep weibold y :|SO ‘WNUIZII/ 
L=d ‘(j04jU09) %7"E 
SA (UONUSAJ9}U!) 
LE =iNsay 
% ‘PISIA L00°0 
Ga peyejas ued > d ‘(jo43U09) GG’OLL 
SA (UONUSAJ9}U!) 
L=d ‘(jo4}U09) €0'7L = HNSeY 
%0 SA (UOHUSAJ94U!) Z6 0=d ‘(J04jU09) GE") SA ueoau ‘abieyosip 
%0 = qNseY (uoWUsAezUl) | |°% = INSeY 72 GAIN eBessay 
ubisaq 
Sa9W09}nO uoljeyusW9|du| auljaseg Apnis 
uoezinn so9wo09jno -JSOd 9W09}nCO ye BW09}NC 
aueoyyeoH | UOlORJSI}ES jUdI}ed S9W09}NOC Uled Buiquosaig ploidg | Buiqiosaig ploidg UuO!}dII9Ssaqg UO}USAJ9}U] | IBS, ‘AOU}]NY 


diyspuemays ploido — Aj 4ayeg aseoyyeaH Buryey\ 


a 


-Buo| JO} seuljepin6 esueyeq 


S80 0=d ‘(jo1}U09) Jo juswyedaq/suleyy Uuela}9/\ dnos6 
(676'L) 9L6°0 ay} sjuswWa|duu! yey} | UOsHedwOd 
SA (UONUSAJ9}U!) Wed} }]NSUCD jJuUsBWebeUeW e um Apnjs 
(v60°Z) 8z 0=d ‘(J04}U09) (g9°gg) aseo Aseuljdiosipsayul ue jo dn | jeuojerasasqo 

60°) =}INSey pr'Se SA (UOHUSAJO AU!) epew si wesboig BuvoyUopy 
(as) ($6°€9) 96'Or = INSeY ploidg pue uojeonpS i870 
ues ‘S}HISIA G3 UN UN (as) ueew ‘asop GG3IN UN uled eg Are ‘UOSUIHe//| 

‘ured 

JO} sinoy ¢ Aaa usjoidnq! 

pue usydouiwejsoe usemjeq 

ayeusaye 0} SUOH}ONAYsU! 

pue ‘awoy je asn pioido 

poy) Buipsebes Buljasunoo 

efseyosip ‘(9 < a100s Hojeue 

Jensia ured 40} pamoye Aju 

sploido) sesoos ured uo paseq 

sploido jo uonejsiulwpe 

yun aed elseujseue 

-jsod pey!tul (Pp) ‘sels UoIsIoU! 

ggee'o=d je pouajsiuiwipe oeyjysoue 

‘({04jU09) (G°ZZ jed0] pue ‘jsiBojolseujsoue 

-G'Z) S| SA (6uueds 84} JO UOHSJOSIP 

pioido) (SL - G2) GZ ay} ye UOHeAS|UIWpe 

SA (ploildo-o198Z) (GL ploido aajesedoe.jul 

8Lz'o=d -G'2) S| =iinsey poyul| Juewebeuew pin 

‘(104jUO0D) (ZG) € SA (woI) payoeu1p-j206 (9) ‘uoyesedo 

(Buueds pioido) (¢°6) p SA ueipew ‘Nnovd 0} Joud Jnoy | papiAoid 

(ploido 0482) (0) 0 = yNseyY Ul SININ 1230. elseBjeue jepowyjnu 

ZZ0'0=d (%) u ‘sAep QE UIYIM anyesiadoaid (q) {joo} juayed 

‘(104jUOD) (ZZ) OL S||Jo1 UOHeoIpew ule | —1000'0=d ‘(]O4}U09) MiaBing Jaisy |O4UOD ule 

sa (6ueds pioido) Z0€8'O=d ‘(J0.,U09) (0ZZ- O87) O8h | SAHoeYa pue ajeg suoebins 

(8°€Z) OL SA (ploldo (OL - 6) OL SA 80'0=d L000°0 = d ‘(joyjuod) | ~~ sa (Buleds pioido) jo a6ajjoD uesewy 34} 

0492) (0) 0 = HNSEY | (Gueds pioido) (0} - ‘(jo4UOD) (7 - |) € SA ($2-G'Z€) Op SA (Buleds (08 - OvZ) OZ SA | Se |[aM Se ‘ainpsdold oyIoeds 
(%) | 6) OL SA(ploido o18z) | (Guyeds pioido) (¢ - |) Z ploido) (G°7Z - LL) GL SA (ploido-0192) (Og 8U} 0} pasoyjey uoabuns ywoyoo 
u ‘sKep ¢ ulyyM | (OL - G°8) OL =3INSey | sa (ploido o49z) (G- €) % | (Ploido-o19z) (0) 0 =3INS8Y | - OZ) O8y = jINSeY 2} UM YSIA JUaHedjno | — aayoedsold 
ubisoq 
S9W09}nO uoljeyusWw9|du| auljeseg Apnis 

uoezinn soawosjno -JSOd 9W09}nCO ye BW09}NC 

aueoyyeoH | UOlORJsI}ES jUaI}ed S9W09}NOC Uled Buiquosaig ploidg | Buiqiiosaig ploidg UuOI}d1I9Ssaqg UONUSAJ9}U] | IRSA ‘AOU}]NY 


diyspuemays ploido — Aj 4ayeg aseoyyeoH Bunyjey\ ES 


SNSIOA = SA SUOTJIADP plepuRjs = CS {eI} po[[ouos poztwopues 
= LOY ‘yun ore ersoyjsoue-jsod =Y\OvVd ‘ouel sppo = YO ‘eaanentuy Suteds proidg = [SC ‘powoder jou = YN ‘syuoyeatnbe wress [TUM ourydiow = APA {esop Ajiep yuayeatnba 


(S78'0) vEEe"O 

SA (UONUSA9}U!) 
(S080) 

68270 = }INseYy 
(as) ueow “ase Arewlid 
‘suonezijeyidsoy ul uled S1U0JYO YM sjusyed 
jualyedu] Buowe Adesay} pioido wie} 


ubisoq 
S9W09}nO uoljeyusW9|du| auljeseg Apnis 
uoezinn so9wo09jno -JSOd 9W09}nCO ye BW09}NC 
aueoyyeoH | UOlORSI}ES jUSI}ed S9W09}NOC Uled Buiquosaig ploidg | Buiqiiosaig ploidg uO!}dII9Ssaqg UONUSAJ9}U] | IRSA ‘AOU]NY 


4.2.5.7 Systematic Reviews Crossing Different Types of 
Interventions 


We identified three systematic reviews that combined different intervention 
types: one in urologic surgery'>;one for frequent emergency department visits due 
to pain”; and part of another systematic review in the ED.” The interventions 
(which included hospital or departmental guidelines for opioid prescriptions, 
analgesic escalation protocols, change in default electronic medical record opioid 
prescription prescriber instructions, patient education and multicomponent 
interventions) showed a statistically significant reduction in opioid prescriptions or 
mean prescribed opioids on discharge,'*4° with no significant worsening of 
patient-reported satisfaction with analgesia, number of phone calls for inadequate 
analgesia, or number of patients requiring emergency visits for pain.!>4 


4.2.6 Question 6. What Are Common Barriers and 
Facilitators to Implementing Opioid Stewardship Practices? 


One systematic review focusing on pharmacists’ role in chronic noncancer 
pain'® addressing barriers and facilitators. Barriers included lack of training and 
confidence, high volume of workload, gaps in communication, inadequate 
monitoring, patient reluctance and expectations, lack of a comprehensive approach, 
inadequate access to alternative treatments, lack of policies and protocols, and lack 
of clear roles. Physician and patient acceptance of the aspects of the intervention 
(e.g., high rates of participation in the intervention and perceived acceptance of 
pharmacists’ role in opioid education and safety) were facilitators. 

The primary effectiveness studies did not formally evaluate barriers and 
facilitators, although many interventions included components that could be 
considered facilitators. Studies about discharge prescribing often included clinician 
education, many studies included patient education, and studies tapering down on 
long-term opioids often included multidisciplinary pain management resources. We 
identified one excluded study that evaluated barriers and facilitators. One RCT 
evaluating implementation of clinical guidelines for opioid prescribing did not 
report clinical outcomes®! but noted that facilitators of guideline adoption included 
using a personal touch for clinic engagement; clear and frequent communication; 
clear expectations for clinic staff; explicit instructions for implementation tools; 
flexibility with clinic constraints and preferences; and familiarity with 
organizational context, workflows, policies, and values. 
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4.2.7 Question 7. What Resources (e.g., Cost, Staff, Time) 
Are Required for Implementation of Opioid Stewardship 
Practices? 


Systematic reviews did not report on cost, staffing, or time. Studies tapering 
down patients on chronic opioids often included or referred to additional resources 
for pain management such as case managers, cognitive behavioral therapy, or 
physical therapy. Cost and time were not documented in the studies that we 
included for effectiveness, but we did identify some additional studies that 
quantified this aspect of implementation. One RCT of implementing clinical 
guidelines for opioid prescribing (which was excluded from our review on Question 
5 because it did not report clinical outcomes) reported on cost, staffing, and time.° 
Across all 4 sites, the facilitator spent 237.7 hours delivering the implementation 
strategy, two physician consultants combined spent 85.7 hours working with sites, 
and each clinic staff member spent approximately 9 hours. The total cost of 
delivering the intervention of the change team (not including clinic staff members’ 
time) was $29,379 or $7345 per clinic. 


4.2.8 Question 8. What Toolkits Are Available To Support 
Implementation of Opioid Stewardship Practices? 


No toolkits were identified in the included reviews, but one primary study 
included a publicly available toolkit to support implementation. A toolkit is 
available from the U.S. VHA for the OSI program evaluated in Vitzthum, et al.4+ 
This toolkit includes educational resources for patients and clinicians, clinical 
practice guidelines, and resources for nonpharmacological pain management 
alternatives (e.g., cognitive behavioral therapy). Additionally, we identified 
publicly available patient safety toolkits developed by the Agency for Healthcare 
Research and Quality (AHRQ) and other organizations that could help support 
implementation of PSPs.° 
AHRQ’s Six Building Blocks: A Team-Based Approach to Improving Opioid 
Management in Primary Care which focuses on improving the quality of care for 
patients with chronic pain who are using long-term opioid therapy. 

AHRQ’s Clinical Decisions Support (CDS) Connect Artifacts on Opioids and Pain 
Management which provides overall guidance and an implementation guide on 
factors to consider in managing chronic pain.° 

American Society of Consultant Pharmacists (ASCP) Opioid Stewardship Toolkit: 
A Pharmacist’s Guide for Older Adults. 

American Hospital Association’s Stem the Tide: Addressing the Opioid Epidemic 
which includes a wide range of resources for clinician, patient, and community 
engagement and education as well as a separate measurement toolkit.®” 

The CDC’s Creating a Culture of Safety for Opioid Prescribing: A Handbook for 
Healthcare Executives.” 
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Electronic Health Record Association’s CDC Opioid Guideline Implementation 
Guide for Electronic Health Records designed to support organization’s use of 
electronic health record-based CDS tools. 

The College of Healthcare Information Management Executives’ (CHIME) Opioid 
Taskforce Playbook which provides a framework to build information technology- 


based supports for Opioid stewardship initiatives. ”° 


The Society for Hospital Medicine’s Reducing Adverse Drug Events Related to 
Opioids Implementation Guide which provides step-by-step guidance to hospital 
teams implementing quality improvement programs to reduce opioid-related 
adverse events.” 

The Institute for Healthcare Improvement’s guide for Advancing the Safety of 
Acute Pain Management which provides stepwise guidance for building a safe and 
effective acute pain management strategy.” 

The Society for Hospital Medicine’s Implementation Guide for Improving Pain 
Management for Hospitalized Medical Patients which provides a process for 
structuring and executing efforts to implement best practices in pain 
management.” 


Health Innovation East opioid deprescribing toolkit.” 
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wy 5. Discussion 


5.1 Summary and Interpretation of Findings 


Research on opioid stewardship interventions has expanded significantly in 
recent years. Included systematic reviews primarily summarized pre-post studies of 
a wide variety of interventions including patient and family engagement, healthcare 
organization policy, and clinician education and training. These interventions were 
evaluated in various healthcare delivery settings including inpatient, perioperative, 
emergency department, and ambulatory care. Randomized controlled trials (RCTs) 
mainly addressed multicomponent interventions, most commonly prescriber 
education, care management and facilitated access to additional resources, and 
patient education and engagement, mainly studying chronic pain in the ambulatory 
setting. 

Given the heterogeneous intervention types, delivery settings, and outcomes 
evaluated, we conclude that opioid stewardship patient safety practices evaluated 
since the release of the 2016 Centers for Disease Control and Prevention (CDC) 
opioid guidelines were associated with decreases in opioid prescribing or doses 
(low strength of evidence). With reduced opioid doses, studies did not find 
increases in unintended consequences of increased pain, or an increase in 
hospitalizations or emergency department visits (low strength of evidence). 
Insufficient evidence was available on opioid refills or requests, patient satisfaction 
or overdose. 

Barriers included lack of training, workload, gaps in communication, and 
inadequate access to nonpharmacological resources. Clinician and patient 
acceptance were identified as important facilitators. We also noted an emphasis on 
the important role of patient engagement and education in these interventions, 
including in nonpharmacological approaches to pain management. 

Below we summarize, by intervention category, the broader literature reported 
in systematic reviews (which generally did not include grading of the strength of 
evidence) and the high-quality primary studies (Table 8). 

No reviews or primary studies were found for dashboards, prescriber feedback, 
or opioid stewardship committees as standalone interventions. 
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Table 8. Summary of the evidence by interventions 


Intervention Category Evidence Summary 

Clinical decision support or e Five systematic reviews found that CDS/EHR interventions may 
electronic health record decrease opioid prescribing with no effect on opioid refill requests. 
interventions 16,21,23,24,26 


e Two RCTs found no significant difference in healthcare utilization (e.g., 
emergency department visits, outpatient visits, and hospitalizations) 
between CDS/EHR interventions and no intervention. Both RCTs found 
the reduced default group had significantly less opioids prescribed at 
baseline although one of the RCTs found an increase in opioid reordering 
for the reduced default group.”?*° 

e One nonrandomized study found decreased emergency department 
opioid and barbiturate prescriptions, no change in pain scores, and mixed 
findings for utilization (i.e., consults, imaging, admissions) after 
implementation of an EHR algorithm.”8 

e The strength of evidence was low for healthcare utilization and opioid 


prescribing. 
Protocol or care bundle e One systematic review found that a protocol for using inpatient opioid 
interventions consumption to guide discharge prescribing was associated with a 


decrease in discharge opioid prescribing.” 
e No reviews or primary studies addressed care bundle interventions in 


isolation. 
e The strength of evidence was insufficient. 
Clinician education or academic e Four systematic reviews addressed the interventions alone.'6!7223 


detailing interventions Three of the four reviews reported the following: 


o Reduced opioid prescribing after the intervention. 
o Increased refill requests or pain-related complaints. 
o No increase in utilization (return visits to the emergency 
department). 
Clinical pharmacist consultation e Two included systematic reviews found a reduction in opioid dose after 
intervention pharmacist intervention. !826 
e Review findings for clinical outcomes were mixed: 
o One review found that 5 of 8 studies showed significant 
reduction in pain intensity. 
o The other review found no increase in post-operative pain, and 
no increases in utilization (hospital visits). 
Increased access or emphasis on | Three systematic reviews found!*!°6: 


nonopioid or multimodal _ e Opioid replacement (replacing one opioid with another) showed no 
analgesia, and/or limits on opioid significant difference in opioid dosing. 
prescribing/ordering intervention e Deprescription methods in ambulatory chronic pain (with or without non- 


pharmacological pain management techniques), coordinated 
recommendations for opioid prescribing, and increasing opioid-free 
prescribing all reduced opioid dose or prescribing. 

e One review on increasing opioid-free prescribing found no differences in 
pain, requirement for additional prescriptions, or satisfaction. 


Healthcare organization Three systematic reviews reported???3°: 

guidelines for opioids and/or Decreases in prescription size and doses 

emphasizing nonopioid pain o General improvement in pain 

medications o No difference in patient satisfaction or phone calls for pain 


o Mixed results for refills or requests 
e One additional primary study demonstrated reduced opioids prescribed 
with no change in patient satisfaction.*! 
e The strength of evidence was insufficient. 
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Intervention Category 


Evidence Summary 


Patient and family education or 
engagement interventions 


Clinical audit interventions 


Peer comparison interventions 


Systematic reviews 
e Generally found significantly reduced or discontinued opioid prescribing. 
e All five systematic reviews assessing pain outcomes found reductions in 
pain intensity. !416192226 
e The review that assessed opioid refill requests found no difference.”’ 


RCTs 

e Four of the five RCTs assessing pain found no statistically significant 
differences in pain between groups.*3-3537 

e Four RCTs reported opioid refill data, with mixed results.*33>-37 

e Three RCTs assessed patient satisfaction.**-3” 

e One RCT reported statistically significant differences, with the 
intervention group being more likely to be satisfied with their pain 
management.** The other two RCTs reported no significant differences 
between conditions. 

e Two RCTs evaluated healthcare utilization and found no differences. *47° 

e Five RCTs assessed opioid prescribing or ordering outcomes after 
surgery with three trials showing no significant differences and two trials 
reporting a statistically significant reduced amount of opioids* in the 
intervention arm compared to the control group. .2737 One RCT evaluated 
inpatient opioid doses and found no differences between groups.*? 


e The strength of evidence was low for pain and low for opioid prescribing. 


e Asystematic review found a decreased overdose rate in one study.7! 
e 


The review also found no change in opioid prescribing. 


A systematic review found reduced opioid prescribing.” 

One RCT of a clinical accountability intervention found no statistically 
significant difference in serious adverse events or death between groups 
but did not evaluate opioid prescribing or process outcomes.** 

e The strength of evidence for peer comparison interventions is insufficient. 


Multicomponent interventions 


Two types of interventions addressed: 

In Hospital settings: System policies on opioid prescribing, workflow 

changes, dashboards, prescriber or patient education. 

In Ambulatory settings: Prescriber education with case management and 

improved access to alternative resources in patients with chronic pain while 

providing patient education and/or nonpharmacological pain management 
support. 

e Systematic reviews concluded that both intervention types were generally 
associated with reduced opioid prescribing with unchanged or improved 
pain. 16,21,23 20 

e Additional primary studies generally saw no increase in unintended 
consequences of pain, early refills or requests, dissatisfaction, and 
emergency department visits or hospitalizations in the intervention group 
compared to the control group.*°*” 

e Additional primary studies generally found associations with reduced 
opioid prescribing in the intervention group compared to the control group 
(5 studies found a reduction and 2 studies found no difference). 

e The strength of evidence was low for pain and low for opioid prescribing. 


CDS =Clinical decision support; EHR= electronic health record; RCT =Randomized controlled trials 
*Amount of opioids” when used in these studies means “number or amount of pills” 
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5.2 Limitations 


We note limitations both of this rapid review and of the literature. Since peaking 
in 2012, opioid prescribing in the United States has markedly decreased over recent 
years. This trend might be influenced by a variety of factors including increased 
recognition of the negative societal impacts of opioid overprescribing, the CDC and 
other prescribing guidelines, state and federal education, legislative initiatives, and 
prescribing norms. Thus, it is challenging to interpret the specific impact of 
interventions evaluated in pre-post studies. We therefore focused on studies with 
stronger designs, but because these mainly focused on only a few types of 
interventions, we also descriptively summarized systematic reviews which included 
pre-post studies to acknowledge the broader lower quality evidence for other kinds 
of interventions. 

We limited our review to systematic reviews and studies that addressed clinical 
outcomes. Although this ensured that we evaluated the potential patient-centered 
unintended consequences of reduced opioid prescribing, this excluded some studies 
of interventions in settings such as the emergency department where followup 
information on pain outcomes may be limited. However, we included systematic 
reviews and studies in the emergency department. The studies also included 
evaluations of unintended consequences of changes in pain, opioid refills, 
hospitalizations, and emergency department use outcomes for which we found low 
strength of evidence. 

The systematic reviews had important limitations. In particular, systematic 
reviews generally did not synthesize the literature but summarized the results of 
individual studies. We also found significant overlap between the studies addressed 
in the systematic reviews. In addition, some of the reviews included studies that 
were out of the scope of our review (e.g., studies outside the United States). 
Because of challenges with the quality of the systematic review methods and their 
heavy dependence on pre-post studies and lack of evidence grading, we reviewed 
RCTs and nonrandomized studies dating back to 2016 (the release of the CDC 
opioid prescribing guidelines) and used these studies as our primary source for 
drawing conclusions and grading the strength of evidence. 

We rated all nonrandomized studies, and all but one of the RCTs, as having a 
high risk of bias, usually due to lack of blinding for outcome assessments, among 
other issues. Some earlier systematic reviews often rated the risk of bias of pre-post 
studies and some of the RCTs as moderate or low risk of bias. We reviewed all 
RCTs dating back to 2016 and based our grading only on the primary studies. Some 
of the earlier systematic reviews rated the strength of evidence as low for opioid 
prescribing outcomes, but other reviews, including Making Healthcare Safer II, 
rated the strength of evidence for opioid prescribing as moderate. Prior reviews did 
not consistently provide their methods for assessing risk of bias and strength of 
evidence, so we noted when our assessments differed from the prior assessments. 
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We included a summary of our assessments of the risk of bias of included primary 
studies since 2016 (see Figures 3 and 4). 


5.3. Implications for Clinical Practice and Future 
Research 


5.3.1. Implication for Clinical Practice 


The increased scope and quality of evaluations of opioid stewardship 
interventions since 2016 can help guide the implementation of guidelines into 
clinical practice. A number of studies focused on tapering down opioids for chronic 
pain in the ambulatory setting, often in conjunction with multidisciplinary pain 
management and nonpharmacologic approaches to reduce opioid use. The studies 
demonstrated that opioids can be tapered and used in lower doses with similar or 
improved pain outcomes if additional resources are provided. Another large 
category of studies included EHR and decision support initiatives such as 
decreasing the default opioid prescription, generally without worsening unintended 
consequences. Another focus was on health system prescribing guidelines on 
appropriate indications for opioids after certain procedures. 

Most studies addressing unintended consequences did not find worsened pain 
when fewer or lower doses of opioids were prescribed. However, these studies did 
not often assess requests for refills as a potential unintended consequence and they 
often did not use rigorous methods for pain measurement and detailed followup. 
Patient reported outcomes were also generally evaluated in a limited way when 
included, with a focus on pain intensity and sometimes patient satisfaction, but less 
often important domains such as functional status. Studies were generally small and 
underpowered to evaluate requests for refills, emergency room visits, 
hospitalizations, or other consequences of uncontrolled pain. Studies were also 
underpowered to evaluate the effect of these interventions on reducing overdoses, a 
relatively rare adverse consequence of opioid ordering and prescribing in the short 
term but a very important issue with chronic use, as are self-harm and suicide 
attempts; these should be addressed in future long-term followup research. 


5.3.2 Future Research 


In 2022, the CDC updated the clinical practice guideline® with the stated 
justification to address unintended consequences of misapplication of the 2016 
guideline, specifically inadequate treatment for pain or abrupt discontinuation of 
opioids and stigma for the treatment of chronic pain and prescription opioid use. 
The findings of this review support that approaches such as including alternative 
modalities for pain control with opioid stewardship patient safety practices might 
help prevent unintended adverse consequences such as increased pain. Opioids play 
a critical role in some acute pain and chronic pain management situations, so 
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flexibility and patient-centered care remains essential to meet the needs of 
individual patients. 

Future research also needs to incorporate the effects of interventions on 
disparities in pain management, ensuring they do not exacerbate known disparities 
in appropriate opioid prescribing. Future research on increasing access to 
nonpharmacologic pain management resources is needed on how best to improve 
opioid stewardship, without worsening pain outcomes. Interventions in practice 
should ideally include meaningful education and engagement of patients on the role 
of opioids and management and provide alternative pain resources. Unintended 
consequences need to be monitored and programs should ensure that access and 
support persists so that issues with uncontrolled pain can be addressed. New 
research is needed on commonly used interventions such as opioid stewardship 
committees, dashboards and peer comparisons, and care bundle interventions such 
as urine drug testing, treatment agreements and prescription drug monitoring 
program queries. These interventions require staff time and effort, and older 
evidence supporting them might be less relevant with reduced opioid prescribing 
patterns and increased health information exchange use. We may need more 
research to evaluate their effectiveness and costs in the current landscape. 

Many of these types of interventions were addressed only in pre-post studies. 
System-level interventions are not as amenable to RCT approaches. To improve the 
quality of research, future studies, when applicable, should include blinding of 
outcome assessments. 

The impact of factors outside health facilities and systems, such as health 
insurance prior authorization for opioids and lack of coverage for non- 
pharmacological interventions, was outside the scope of our review but can impact 
prescribing. Future research on the impact of factors outside of the healthcare 
delivery setting is needed. Future reviews should also address the outcome of 
examination of unused opioids from prescriptions in the setting of acute pain 
management. We also note that lack of access to or long wait times for 
nonpharmacological pain management resources present challenges to patient care. 
Future research on the social determinants of health may also provide insight on 
ways to improve pain management and opioid safety. 
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Appendixes 


Appendix A. Methods 


Search Strategies for Published Literature 


Table A-1. PubMed search strategy 


# | Concept Search Terms 

1 | Opioid "Analgesics, Opioid"[Mesh] OR opioid [tiab] OR opioids [tiab] OR opiate [tiab] OR 
opiates [tiab] OR "morphine milligram equivalents" [tiab] 

2 | Intervention “Decision Support Systems, Clinical’ [mh] OR “Health Information Exchange” [mh] 


OR “Health Information Systems” [mh] OR “Prescription Drug Monitoring Programs” 
[mh] OR “Drug Monitoring” [mh] OR “Stewardship” [tiab] OR “Prescription Drug 
Monitoring Program” [tiab] OR “Treatment Agreement” [tiab] OR “Patient Contract” 
[tiab] OR “risk assessment” [tiab] OR “Clinical Decision*” [tiab] OR “Health 
Information Technology” [tiab] OR “Monitoring” [tiab] OR “Patient Registry” [tiab] OR 
“Dashboard” [tiab] OR “Feedback Approach” [tiab] OR “prescriber feedback” [tiab] 
OR “Electronic Health Records” [MH] OR “electronic health record” [tiab] OR 
intervention*[tiab] OR guideline*[tiab] OR stewardship*[tiab] OR monitor*[tiab] OR 
program*[tiab] OR alert*[tiab] OR benchmark*[tiab] OR protocols [tiab] OR “care 
bundle” [tiab] OR “clinical audit’[tiab] OR “pharmacist consultation’[tiab] OR “peer 
comparison” [tiab] OR restriction [tiab] OR reminder [tiab] OR “risk reduction” [tiab] 


3 | Patient safety/harm "patient safety"[mh] OR "patient safety" [tiab] OR "Patient Harm"[mh] OR "Patient 
Harm*"[tiab] OR "patient risk*"[tiab] OR "quality care" [tiab] OR “adverse event*"[tiab] 
OR "undesired event*"[tiab] OR "medical errors"[mh] OR "medical error*"[tiab] OR 
"Diagnostic Errors" [mh] OR "diagnostic error*"[tiab] OR "diagnostic mistake*"[tiab] 
OR "health care error*"[tiab] OR "healthcare error*"[tiab] OR "medical fault*"[tiab] OR 
"medical mistake*"[tiab] OR "erroneous diagnos*"[tiab] OR "failure to diagnose"[tiab] 
OR "false diagnos*"[tiab] OR "faulty diagnos*"[tiab] OR misdiagnos*[tiab] OR 
"mistaken diagnos*"[tiab] OR "wrong diagnos*"[tiab] OR "Practice Patterns, 
Physicians” [Mesh] OR prescription [tiab] OR prescriptions [tiab] OR prescribing [tiab] 
OR “drug prescriptions” [majr] OR “drug monitoring” [majr] 


#1 AND #2 AND #3 #1 AND #2 AND #3 


ole 


#4 NOT address[pt] OR "autobiography"[pt] OR "bibliography"[pt] OR "biography"[pt] OR 
congress[pt] OR "dictionary"[pt] OR "directory"[pt] OR "festschrift"[pt] OR "historical 
article"[pt] OR lecture[pt] OR "legal case"[pt] OR "legislation"[pt] OR "periodical 
index"[pt] OR Comment[pt] OR Letter[pt] OR Editorial[pt] OR “news”[pt] OR 
“newspaper article”[pt] OR “patient education handout’[pt] OR “periodical index” [pt] 
OR “study guide” [pt] OR rats[tw] OR cow[tw] OR cows[tw] OR chicken[tw] OR 
chickens[tw] OR horse[tw] OR horses[tw] OR mice[tw] OR mouse[tw] OR bovine[tw] 
OR sheep[tw] OR ovine OR murine[tw] OR "Case Reports"[pt] OR “cocaine use’ [ti] 
OR “opioid use disorders’[ti] OR “opioid use disorder’[ti] OR "nursing home" [ti] OR 
"opioid abuse"[ti] OR "insurance"[ti] OR federal [ti] OR "opioid addiction"[ti] OR 
"Medication assisted treatment"[ti] OR "scoping review'[ti] OR "integrative review'[ti] 
OR "rapid review" [ti] OR "living review"[ti] OR "environmental scan"|[ti] 


6 | PubMed Filter - 
English 

7 | #6 AND 2016-April 
2023 


8 | #6 and PubMed Filter- | For systematic reviews only 
“Systematic Review” 


9 | #8 AND 2019 -April For systematic reviews only 
2023 
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Table A-2. Cochrane search strategy 


# 


Concept 


Search Terms 


1 


Opioid 


((opioid OR opioids OR opiate OR opiates OR "morphine milligram equivalents"):ti 
OR (opioid OR opioids OR opiate OR opiates OR "morphine milligram 
equivalents"):ab OR "Analgesics, Opioid"[Mesh]) AND ((“Stewardship” OR 
“Prescription Drug Monitoring Program” OR “Treatment Agreement” OR “Patient 
Contract” OR “risk assessment” OR “Clinical Decision*” OR “Health Information 
Technology” OR “Monitoring” OR “Patient Registry” OR “Dashboard” OR “Feedback 
Approach” OR “prescriber feedback” OR “electronic health record” OR intervention* 
OR guideline* OR stewardship* OR monitor* OR program* OR alert* OR benchmark* 
OR protocols OR “care bundle” OR “clinical audit” OR “pharmacist consultation” OR 
“peer comparison” OR restriction OR reminder OR “risk reduction”):ti OR 
(“Stewardship” OR “Prescription Drug Monitoring Program” OR “Treatment 
Agreement” OR “Patient Contract” OR “risk assessment” OR “Clinical Decision*”” OR 
“Health Information Technology” OR “Monitoring” OR “Patient Registry” OR 
“Dashboard” OR “Feedback Approach” OR “prescriber feedback” OR “electronic 
health record” OR intervention* OR guideline* OR stewardship* OR monitor* OR 
program* OR alert* OR benchmark* OR protocols OR “care bundle” OR “clinical 
audit” OR “pharmacist consultation” OR “peer comparison” OR restriction OR 
reminder OR “risk reduction”):ab OR Electronic Health Records”[Mesh] OR “Decision 
Support Systems, Clinical’[Mesh] OR “Health Information Exchange’[Mesh] OR 
“Health Information Systems”[Mesh] OR “Prescription Drug Monitoring 
Programs”[Mesh] OR “Drug Monitoring”[Mesh]) 


Patient 
safety/harm 


("patient safety" OR "Patient Harm*" OR "patient risk*" OR "quality care" OR “adverse 
event*" OR "undesired event*" OR "medical error*" OR "diagnostic error*" OR 
"diagnostic mistake*" OR "health care error*" OR "healthcare error*" OR "medical 
fault*" OR "medical mistake*" OR "erroneous diagnos*" OR "failure to diagnose" OR 
"false diagnos*" OR "faulty diagnos*" OR misdiagnos* OR "mistaken diagnos*" OR 
"wrong diagnos*" OR prescription OR prescriptions OR prescribing):ti OR ("patient 
safety" OR "Patient Harm*" OR "patient risk*" OR "quality care" OR “adverse event*" 
OR "undesired event*" OR "medical error*" OR "diagnostic error*" OR "diagnostic 
mistake*" OR "health care error*" OR "healthcare error*" OR "medical fault*" OR 
"medical mistake*" OR "erroneous diagnos*" OR "failure to diagnose" OR "false 
diagnos*" OR "faulty diagnos*" OR misdiagnos* OR "mistaken diagnos*" OR "wrong 
diagnos*" OR prescription OR prescriptions OR prescribing):ab OR ("Patient 
Harm"[Mesh] OR "patient safety"[Mesh] OR "medical errors"[Mesh] OR "Diagnostic 
Errors" [Mesh] OR "Practice Patterns, Physicians” [Mesh] OR “drug 


monitoring”[Mesh]) 


Making Healthcare Safer IV — Opioid Stewardship 


Concept 


Search Terms 


| Fk 


#1 AND #2 


(((opioid OR opioids OR opiate OR opiates OR "morphine milligram equivalents"):ti 
OR (opioid OR opioids OR opiate OR opiates OR "morphine milligram 
equivalents"):ab OR "Analgesics, Opioid"[Mesh]) AND ((“Stewardship” OR 
“Prescription Drug Monitoring Program” OR “Treatment Agreement” OR “Patient 
Contract” OR “risk assessment” OR “Clinical Decision*” OR “Health Information 
Technology” OR “Monitoring” OR “Patient Registry” OR “Dashboard” OR “Feedback 
Approach” OR “prescriber feedback” OR “electronic health record” OR intervention* 
OR guideline* OR stewardship* OR monitor* OR program* OR alert* OR benchmark* 
OR protocols OR “care bundle” OR “clinical audit” OR “pharmacist consultation” OR 
“peer comparison” OR restriction OR reminder OR “risk reduction”):ti OR 
(“Stewardship” OR “Prescription Drug Monitoring Program” OR “Treatment 
Agreement” OR “Patient Contract” OR “risk assessment” OR “Clinical Decision*” OR 
“Health Information Technology” OR “Monitoring” OR “Patient Registry” OR 
“Dashboard” OR “Feedback Approach” OR “prescriber feedback” OR “electronic 
health record” OR intervention* OR guideline* OR stewardship* OR monitor* OR 
program* OR alert* OR benchmark* OR protocols OR “care bundle” OR “clinical 
audit” OR “pharmacist consultation” OR “peer comparison” OR restriction OR 
reminder OR “risk reduction”):ab OR Electronic Health Records”[Mesh] OR “Decision 
Support Systems, Clinical’[Mesh] OR “Health Information Exchange”’[Mesh] OR 
“Health Information Systems”[Mesh] OR “Prescription Drug Monitoring 
Programs”[Mesh] OR “Drug Monitoring’[Mesh])) AND (("patient safety" OR "Patient 
Harm*" OR "patient risk*" OR "quality care" OR “adverse event*" OR "undesired 
event*" OR "medical error*" OR "diagnostic error*" OR "diagnostic mistake*" OR 
"health care error*" OR "healthcare error*" OR "medical fault*" OR "medical mistake*" 
OR "erroneous diagnos*" OR "failure to diagnose" OR "false diagnos*" OR "faulty 
diagnos*" OR misdiagnos* OR "mistaken diagnos*" OR "wrong diagnos*" OR 
prescription OR prescriptions OR prescribing):ti OR ("patient safety" OR "Patient 
Harm*" OR "patient risk*" OR "quality care" OR “adverse event*" OR "undesired 
event*" OR "medical error*" OR "diagnostic error*" OR "diagnostic mistake*" OR 
"health care error*" OR "healthcare error*" OR "medical fault*" OR "medical mistake*" 
OR "erroneous diagnos*" OR "failure to diagnose" OR "false diagnos*" OR "faulty 
diagnos*" OR misdiagnos* OR "mistaken diagnos*" OR "wrong diagnos*" OR 
prescription OR prescriptions OR prescribing):ab OR ("Patient Harm"[Mesh] OR 
"patient safety"[Mesh] OR “medical errors"[Mesh] OR "Diagnostic Errors" [Mesh] OR 
"Practice Patterns, Physicians” [Mesh] OR “drug monitoring’[Mesh 


4. #3 NOT ((address OR "autobiography" OR "bibliography" OR "biography" OR congress OR 
"dictionary" OR "directory" OR "festschrift" OR "historical article" OR lecture OR "legal 
case" OR "legislation" OR "periodical index" OR Comment OR Letter OR Editorial OR 
“news” OR “newspaper article” OR “patient education handout” OR “periodical index” 
OR “study guide” OR "Case Reports"):pt OR (rats OR cow OR cows OR chicken OR 
chickens OR horse OR horses OR mice OR mouse OR bovine OR sheep OR ovine 
OR murine):kw OR (“cocaine use” OR “opioid use disorders” OR “opioid use disorder” 
OR "nursing home" OR "opioid abuse" OR "insurance" OR federal OR "opioid 
addiction" OR "Medication assisted treatment" OR "scoping review" OR "integrative 
review" OR "rapid review" OR "living review" OR "environmental scan"):ti 

5 #4 English only 

6 #5 and 2019 to 

April 2023 for 
systematic 
reviews 

#7 #5 and 2016 to 


April 2023 for non- 
systematic 
reviews 
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Acharya PP, Fram BR, Adalbert JR, et al. 
Impact of an Educational Intervention on the 
Opioid Knowledge and Prescribing Behaviors 
of Resident Physicians. Cureus. 2022 

Mar; 14(3):e23508. doi: 10.7759/cureus.23508. 
PMID: 35494931. - Qualitative study 
without any quantitative data 


Acquisto NM, Schult RF, Sarnoski-Roberts S, 
et al. Effect of pharmacist-led task force to 
reduce opioid prescribing in the emergency 
department. Am J Health Syst Pharm. 2019 
Oct 30;76(22):1853-61. doi: 
10.1093/ajhp/zxz204. PMID: 31557284. - 
Other: Study included in previous 
systematic reviews 


Adalbert JR, Ilyas AM. Implementing 
Prescribing Guidelines for Upper Extremity 
Orthopedic Procedures: A Prospective 
Analysis of Postoperative Opioid Consumption 
and Satisfaction. Hand (N Y). 2021 

Jul; 16(4):491-7. doi: 

10.1177/15589447 19867122. PMID: 
31441326. - No comparison group 


Agarwal AK, Lee D, Ali Z, et al. Patient- 
Reported Opioid Consumption and Pain 
Intensity After Common Orthopedic and 
Urologic Surgical Procedures With Use of an 
Automated Text Messaging System. JAMA 
Netw Open. 2021 Mar 1;4(3):e213243. doi: 
10.1001/jamanetworkopen.2021.3243. PMID: 
33764425. - Not focused on an intervention 
of interest 


Ahonle ZJ, Jia H, Mudra SA, et al. Drug 
Overdose and Suicide Among Veteran 
Enrollees in the VHA: Comparison Among 
Local, Regional, and National Data. Fed Pract. 
2020 Sep;37(9):420-5. doi: 10.12788/fp.0025. 
PMID: 33029067. - Does not address an 
outcome of interest 


Al-Astal AY, Sodhi K, Lakhani HV. 
Optimization of Prescription Drug Monitoring 
Program to Overcome Opioid Epidemic in 
West Virginia. Cureus. 2022 

Feb; 14(2):e22434. doi: 10.7759/cureus.22434. 
PMID: 35371719. - Narrative or scoping 
review 


Alderson SL, Farragher TM, Willis TA, et al. 
The effects of an evidence- and theory- 


Appendix B. List of Excluded Studies Upon Full-Text Review 


informed feedback intervention on opioid 
prescribing for non-cancer pain in primary 
care: A controlled interrupted time series 
analysis. PLoS Med. 2021 
Oct;18(10):e1003796. doi: 
10.1371/journal.pmed.1003796. PMID: 
34606504. - Addresses effectiveness review 
question only but does not report clinical 
outcomes 


Alenezi A, Yahyouche A, Paudyal V. 
Interventions to optimize prescribed medicines 
and reduce their misuse in chronic non- 
malignant pain: a systematic review. Eur J Clin 
Pharmacol. 2021 Apr;77(4):467-90. doi: 
10.1007/s00228-020-03026-4. PMID: 
33123784. - Not focused on an intervention 
of interest 


Alford DP, Zisblatt L, Ng P, et al. SCOPE of 
Pain: An Evaluation of an Opioid Risk 
Evaluation and Mitigation Strategy Continuing 
Education Program. Pain Med. 2016 
Jan;17(1):52-63. doi: 10.1111/pme.12878. 
PMID: 26304703. - Addresses 
implementation review question [6 and 7] 
but does not report clinical outcomes 


Alogaili F, Abdul Ghani N, Ahmad Kharman 
Shah N. Prescription drug monitoring 
programs in the US: A systematic literature 
review on its strength and weakness. J Infect 
Public Health. 2020 Oct;13(10):1456-61. doi: 
10.1016/j.jiph.2020.06.035. PMID: 32694082. 
- Intervention or policies established by 
entities other than healthcare providers 


Andereck J, Reuter Q, Kim HS, et al. 
Implementation of a novel audit and feedback 
program on discharge opioid prescribing. 
Academic emergency medicine. 2018;25:S52. 
doi: 10.1111/acem.13424. PMID: CN- 
01612744. - Conference, meeting abstract, 
or poster 


Andereck JW, Reuter QR, Allen KC, et al. A 
Quality Improvement Initiative Featuring Peer- 
Comparison Prescribing Feedback Reduces 
Emergency Department Opioid Prescribing. Jt 
Comm J Qual Patient Saf. 2019 
Oct;45(10):669-79. doi: 
10.1016/j.jcjq.2019.07.008. PMID: 31488343. 
- Addresses effectiveness review question 
only but does not report clinical outcomes 
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Anne S, Mims JW, Tunkel DE, et al. Clinical 
Practice Guideline: Opioid Prescribing for 
Analgesia After Common Otolaryngology 
Operations Executive Summary. Otolaryngol 
Head Neck Surg. 2021 Apr;164(4):687-703. 
doi: 10.1177/019459982 1996303. PMID: 
33822678. - Qualitative study without any 
quantitative data 


Arizmendez NP, Kotovicz F, Kram JJF, et al. 
Multimodal Local Opioid Prescribing 
Intervention Outcomes in Chronic Noncancer 
Pain Management. J Am Board Fam Med. 
2019 Jul-Aug;32(4):559-66. doi: 
10.3122/jabfm.2019.04.180296. PMID: 
31300576. - Addresses effectiveness review 
question only but does not report clinical 
outcomes 


Asamoah-Boaheng M, Badejo OA, Bell LV, et 
al. Interventions to Influence Opioid 
Prescribing Practices for Chronic Noncancer 
Pain: A Systematic Review and Meta- 
Analysis. Am J Prev Med. 2021 Jan;60(1):e15- 
e26. doi: 10.1016/j.amepre.2020.07.012. 
PMID: 33229143. - Addresses effectiveness 
review question only but does not report 
clinical outcomes 


Ash N, Tuten J, Bohenek W, et al. A 
comprehensive approach to addressing the 
opioid epidemic in a large health system. Am J 
Health Syst Pharm. 2021 Feb 8;78(4):320-6. 
doi: 10.1093/ajhp/zxaa388. PMID: 33471051. 
- Qualitative study without any quantitative 
data 


Aulet RM, Trieu V, Landrigan GP, et al. 
Changes in Opioid Prescribing Habits for 
Patients Undergoing Rhinoplasty and 
Septoplasty. JAMA Facial Plast Surg. 2019 
Dec 1;21(6):487-90. doi: 
10.1001/jamafacial.2019.0937. PMID: 
31600382. - Intervention or policies 
established by entities other than healthcare 
providers 


Awadalla R, Gnjidic D, Patanwala A, et al. 
The Effectiveness of Stewardship 
Interventions to Reduce the Prescribing of 
Extended-Release Opioids for Acute Pain: A 
Systematic Review. Pain Med. 2020 Oct 
1;21(10):2401-11. doi: 10.1093/pm/pnaal 39. 
PMID: 32488237. - Addresses effectiveness 
review question only but does not report 
clinical outcomes 


Babino JM, Thornton JD, Putney K, et al. 
Evaluation of Discharge Opioid Prescribing in 
Coronary Artery Bypass Patients Following an 
Opioid Stewardship Intervention for Providers. 
J Pharm Pract. 2022 Apr 
11:8971900221088797. doi: 
10.1177/08971900221088797. PMID: 
35410543. - Addresses effectiveness review 
question only but does not report clinical 
outcomes 


Badreldin N, Ditosto JD, Holder K, et al. 
Interventions to Reduce Inpatient and 
Discharge Opioid Prescribing for Postpartum 
Patients: A Systematic Review. J Midwifery 
Womens Health. 2023 Mar;68(2):187-204. 
doi: 10.1111/jmwh. 13475. PMID: 36811227. - 
Addresses effectiveness review question only 
but does not report clinical outcomes 


Baird J, Faul M, Green TC, et al. Evaluation of 
a Safer Opioid Prescribing Protocol (SOPP) 
for Patients Being Discharged From a Trauma 
Service. J Trauma Nurs. 2019 
May/Jun;26(3):113-20. doi: 
10.1097/jtn.0000000000000435. PMID: 
31483766. - Addresses effectiveness review 
question only but does not report clinical 
outcomes 


Ball SJ, McCauley JA, Pruitt M, et al. 
Academic detailing increases prescription drug 
monitoring program use among primary care 
practices. J Am Pharm Assoc (2003). 2021 Jul- 
Aug;61(4):418-24.e2. doi: 
10.1016/j.japh.2021.02.019. PMID: 33812783. 
- Intervention or policies established by 
entities other than healthcare providers 


Barrett TW, McEvoy MD, Fowler LC, et al. 
Impact of an Asynchronous Spaced Education 
Learning Intervention on Emergency Medicine 
Clinician Opioid Prescribing. Cureus. 2021 
Sep;13(9):e18165. doi: 10.7759/cureus. 18165. 
PMID: 34707949. - Addresses effectiveness 
review question only but does not report 
clinical outcomes 


Barth KS, Ball S, Adams RS, et al. 
Development and Feasibility of an Academic 
Detailing Intervention to Improve Prescription 
Drug Monitoring Program Use Among 
Physicians. J Contin Educ Health Prof. 2017 
Spring;37(2):98-105. doi: 
10.1097/ceh.0000000000000149. PMID: 
28562498. - Addresses implementation 
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review question [6 and 7] but does not 
report clinical outcomes 


Barth KS, Guille C, McCauley J, et al. 
Targeting practitioners: A review of 
guidelines, training, and policy in pain 
management. Drug Alcohol Depend. 2017 Apr 
1;173 Suppl 1(Suppl 1):S22-s30. doi: 
10.1016/j.drugalcdep.2016.08.641. PMID: 
28363316. - Systematic review published 
before 2019 


Baxter KJ, Short HL, Wetzel M, et al. 
Decreased opioid prescribing in children using 
an enhanced recovery protocol. J Pediatr Surg. 
2019 Jun;54(6):1104-7. doi: 
10.1016/j.jpedsurg.2019.02.044. PMID: 
30885561. - Not focused on an intervention 
of interest 


Beaudoin FL, Banerjee GN, Mello MJ. State- 
level and system-level opioid prescribing 
policies: The impact on provider practices and 
overdose deaths, a systematic review. J Opioid 
Manag. 2016 May-Jun; 12(2):109-18. doi: 
10.5055/jom.2016.0322. PMID: 27194195. - 
Systematic review published before 2019 


Behar E, Bagnulo R, Coffin PO. Acceptability 
and feasibility of naloxone prescribing in 
primary care settings: A systematic review. 
Prev Med. 2018 Sep;114:79-87. doi: 
10.1016/j.ypmed.2018.06.005. PMID: 
29908763. - Systematic review published 
before 2019 


Belavy DL, Tagliaferri SD, Buntine P, et al. 
Clinician education unlikely effective for 
guideline-adherent medication prescription in 
low back pain: systematic review and meta- 
analysis of RCTs. EClinicalMedicine. 2022 
Jan;43:101193. doi: 
10.1016/j.eclinm.2021.101193. PMID: 
35028542. - Addresses effectiveness review 
question only but does not report clinical 
outcomes 


Benavent KA, Altschul ND, Lincoln LF, et al. 
Patient Satisfaction and Opioid Use With a 
Postoperative Opioid Protocol After Common 
Hand Procedures. J Hand Surg Glob Online. 
2020 Jul;2(4):191-5. doi: 
10.1016/j.jhsg.2020.04.003. PMID: 35415503. 
- No comparison group 


Bérubé M, Dupuis S, Leduc S, et al. Tapering 
Opioid Prescription Program for High-Risk 
Trauma Patients: A Pilot Randomized 


Controlled Trial. Pain Manag Nurs. 2022 
Apr;23(2):142-50. doi: 
10.1016/j.pmn.2021.08.001. PMID: 34479822. 
- Non-USA based study or does not report 
data separately for USA 


Bestha D, Tomatsu S, Hutcheson B, et al. 
Impact of an opioid prescribing alert system on 
patients with posttraumatic stress disorder. Am 
J Addict. 2022 Mar;31(2):123-31. doi: 

10.1111 /ajad.13261. PMID: 35112432. - 
Addresses effectiveness review question only 
but does not report clinical outcomes 


Billings JD, Huynh V, Leonard LD, et al. 
Addressing an epidemic: Improving guideline- 
concordant opioid prescribing in surgical 
patients. Surgery. 2022 Nov;172(5):1407-14. 
doi: 10.1016/j.surg.2022.06.033. PMID: 
36088172. - Addresses effectiveness review 
question only but does not report clinical 
outcomes 


Blaga V, Seth K, Valentim C, et al. Opioid 
Prescription in Ophthalmology and the Impact 
of a Decision Support Tool in Reducing 
Excess Dosing. Am J Ophthalmol. 2022 
Nov;243:34-41. doi: 

10.1016/j.ajo.2022.06.019. PMID: 35809659. - 
Addresses effectiveness review question only 
but does not report clinical outcomes 


Bleicher J, Fender Z, Johnson JE, et al. Use of 
post-discharge opioid consumption patterns as 
a tool for evaluating opioid prescribing 
guidelines. Am J Surg. 2022 Jul;224(1 Pt 
A):58-63. doi: 10.1016/j.amjsurg.2021.12.020. 
PMID: 34973685. - Not focused on an 
intervention of interest 


Bleicher J, Stokes SM, Brooke BS, et al. 
Patient-centered Opioid Prescribing: Breaking 
Away From One-Size-Fits-All Prescribing 
Guidelines. J Surg Res. 2021 Aug;264:1-7. 
doi: 10.1016/j.jss.2021.01.048. PMID: 
33744772. - Addresses effectiveness review 
question only but does not report clinical 
outcomes 


Blind F, Melton J, Karp J, et al. Evaluation of 
the use of individualized patient care plans in 
frequent emergency department visitors with 
pain complaints. Int J Emerg Med. 2022 Aug 
22315(1):37. doi: 10.1186/s12245-022-00440- 
6. PMID: 35996083. - Addresses 
effectiveness review question only but does 
not report clinical outcomes 
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Bloom DA, Manjunath AK, Gualtieri AP, et 
al. Patient Satisfaction After Total Hip 
Arthroplasty Is Not Influenced by Reductions 
in Opioid Prescribing. J Arthroplasty. 2021 
Jul;36(7s):S250-s7. doi: 
10.1016/j.arth.2021.02.009. PMID: 33640183. 
- Not focused on an intervention of interest 


Bohnert ASB, Guy GP, Jr., Losby JL. Opioid 
Prescribing in the United States Before and 
After the Centers for Disease Control and 
Prevention's 2016 Opioid Guideline. Ann 
Intern Med. 2018 Sep 18;169(6):367-75. doi: 
10.7326/m18-1243. PMID: 30167651. - 
Addresses effectiveness review question only 
but does not report clinical outcomes 


Bongiovanni T, Hansen K, Lancaster E, et al. 
Adopting best practices in post-operative 
analgesia prescribing in a safety-net hospital: 
Residents as a conduit to change. Am J Surg. 
2020 Feb;219(2):299-303. doi: 
10.1016/j.amjsurg.2019.12.023. PMID: 
31928779. - Addresses effectiveness review 
question only but does not report clinical 
outcomes 


Booth D, Amalfitano C, Forestine A. Changes 
in Opioid Prescription Rates at Discharge 
After Targeted Provider Education in the 
Emergency Department. J Pharm Pract. 2022 
Nov 13:8971900221131911. doi: 
10.1177/08971900221131911. PMID: 
36373419. - Addresses effectiveness review 
question only but does not report clinical 
outcomes 


Boren LL, Locke AM, Friedman AS, et al. 
Team-Based Medicine: Incorporating a 
Clinical Pharmacist into Pain and Opioid 
Practice Management. Pm r. 2019 
Nov;11(11):1170-7. doi: 10.1002/pmrj.12127. 
PMID: 30729723. - Other: Study included in 
previous systematic reviews 


Borrelli EP, Bratberg J, Hallowell BD, et al. 
Application of a diazepam milligram 
equivalency algorithm to assess 
benzodiazepine dose intensity in Rhode Island 
in 2018. J Manag Care Spec Pharm. 2022 
Jan;28(1):58-68. doi: 
10.18553/jmcp.2022.28.1.58. PMID: 
34949119. - Not focused on an intervention 
of interest 


Bossenbroek Fedoriw K, Prentice A, Slatkoff 
S, et al. A Systematic Approach to Opioid 
Prescribing. J Am Board Fam Med. 2020 Nov- 


Dec;33(6):992-7. doi: 
10.3122/jabfm.2020.06.190463. PMID: 
33219078. - Addresses effectiveness review 
question only but does not report clinical 
outcomes 


Bourgeois HC, Proteau RC, Vielma CV, et al. 
Evaluation of an Interdisciplinary Controlled 
Substance Review Committee on Opioid 
Prescribing in a Community Health Center. 
Pain Med. 2020 Sep 1;21(9):1840-6. doi: 
10.1093/pm/pnaa075. PMID: 32289825. - 
Addresses effectiveness review question only 
but does not report clinical outcomes 


Boyle KL, Cary C, Dizitzer Y, et al. Reduction 
of opioid prescribing through the sharing of 
individual physician opioid prescribing 
practices. Am J Emerg Med. 2019 
Jan;37(1):118-22. doi: 
10.1016/j.ajem.2018.09.052. PMID: 
30343961. - Addresses effectiveness review 
question only but does not report clinical 
outcomes 


Brandal D, Keller MS, Lee C, et al. Impact of 
Enhanced Recovery After Surgery and Opioid- 
Free Anesthesia on Opioid Prescriptions at 
Discharge From the Hospital: A Historical- 
Prospective Study. Anesth Analg. 2017 
Nov;125(5):1784-92. doi: 
10.1213/ane.0000000000002510. PMID: 
29049123. - Other: ERAS pathway 


Brar S, Aujla S, Tang S, et al. Impact of a 
Clinical Intervention to Decrease Opioid 
Prescribing in a Post-Cesarean Delivery. J 
Obstet Gynaecol Can. 2022 Apr;44(4):398- 
402. doi: 10.1016/j.jogc.2021.11.009. PMID: 
34848352. - Non-USA based study or does 
not report data separately for USA 


Bredemeyer M. CDC Develops Guideline for 
Opioid Prescribing. Am Fam Physician. 2016 
Jun 15;93(12):1042-3. PMID: 27304778. - No 
original data (opinion, descriptive data, 
letters, editorial, commentary) 


Breeden MA, Jacobs CK, Witthaus M, et al. 
Prescribing Patterns and Use of Risk- 
Reduction Tools After Implementing an 
Opioid-Prescribing Protocol. J Am Board Fam 
Med. 2020 Jan-Feb;33(1):27-33. doi: 
10.3122/jabfm.2020.01.190247. PMID: 
31907243. - Addresses effectiveness review 
question only but does not report clinical 
outcomes 
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Brose SW, Schneck H, Bourbeau DJ. An 
Interdisciplinary Approach to Reducing Opioid 
Prescriptions to Patients with Chronic Pain ina 
Spinal Cord Injury Center. Pm r. 2019 
Feb;11(2):135-41. doi: 
10.1016/j.pmrj.2018.09.030. PMID: 

30266347. - Addresses effectiveness review 
question only but does not report clinical 
outcomes 


Burns S, Urman R, Pian R, et al. Reducing 
New Persistent Opioid Use After Surgery: A 
Review of Interventions. Curr Pain Headache 
Rep. 2021 Mar 24;25(5):27. doi: 
10.1007/s11916-021-00943-6. PMID: 
33760983. - Narrative or scoping review 


Buttorff C, Trujillo AJ, Castillo R, et al. The 
impact of practice guidelines on opioid 
utilization for injured workers. Am J Ind Med. 
2017 Dec;60(12):1023-30. doi: 
10.1002/ajim.22779. PMID: 28990210. - 
Addresses effectiveness review question only 
but does not report clinical outcomes 


Calcaterra SL, Butler M, Olson K, et al. The 
Impact of a PDMP-EHR Data Integration 
Combined With Clinical Decision Support on 
Opioid and Benzodiazepine Prescribing Across 
Clinicians in a Metropolitan Area. J Addict 
Med. 2022 May-Jun 01;16(3):324-32. doi: 
10.1097/adm.0000000000000905. PMID: 
34392255. - Addresses effectiveness review 
question only but does not report clinical 
outcomes 


Calderon T, Hedges E, Livingston MH, et al. 
Opioid stewardship in pediatric surgery: 
Approaching zero. J Pediatr Surg. 2021 
Mar;56(3):573-9. doi: 
10.1016/j.jpedsurg.2020.08.035. PMID: 
33008639. - Not focused on an intervention 
of interest 


Carey CM, Meille G, Buchmueller TC. 
Provider Compliance With Kentucky's 
Prescription Drug Monitoring Program's 
Mandate To Query Patient Opioid History. 
Health Aff (Millwood). 2021 Mar;40(3):461-8. 
doi: 10.1377/hlthaff.2020.01316. PMID: 
33646863. - Intervention or policies 
established by entities other than healthcare 
providers 


Carlile N, Fuller TE, Benneyan JC, et al. 
Lessons Learned in Implementing a Chronic 
Opioid Therapy Management System. J Patient 
Saf. 2022 Dec 1;18(8):e1142-e9. doi: 


10.1097/pts.0000000000001039. PMID: 
35617623. - Addresses implementation 
review question [6 and 7] but does not 
report clinical outcomes 


Carlson A, Nelson ME, Patel H. Longitudinal 
impact of a pre-populated default quantity on 
emergency department opioid prescriptions. J 
Am Coll Emerg Physicians Open. 2021 
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